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PREFACE 


This report presents major findings of the research program entitled, “Reliability Based 
Structural Optimization,” sponsored by NASA Lewis Research Center, Grant No. NAG 
3 - 1489. Mr. Dale Hopkins was the NASA Technical Officer. 

This report is intended for the demonstration of function approximation concepts 
and their applicability in reliability analysis and design. Particularly, approximations 
in the calculation of the safety index, failure probability and structural optimization 
(modification of design variables) are developed. With this scope in mind, extensive 
details on probability theory are avoided. Definitions relevant to the stated objectives 
have been taken from standard text books. 

The idea of function approximations is to minimize the repetitive use of 
computationally intensive calculations by replacing them with simpler closed-form 
equations, which could be nonlinear. Typically, the approximations provide good accuracy 
around the points where they are constructed, and they need to be periodically updated 
to extend their utility. 

There are approximations in calculating the failure probability of a limit state function. 
The first one, which is most commonly discussed, is how the limit state is approximated at 
the design point. Most of the time this could be a first-order Taylor series expansion, also 
known as the First Order Reliability Method (FORM), or a second-order Taylor series 
expansion (paraboloid), also known as the Second Order Reliability Method (SORM). 
From the computational procedure point of view, this step comes after the design point 
identification; however, the order of approximation for the probability of failure calculation 
is discussed first, and it is denoted by either FORM or SORM. 

The other approximation of interest is how the design point, or the most probable 
failure point (MPP), is identified. For iteratively finding this point, again the limit 
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state is approximated. The accuracy and efficiency of the approximations make the 
search process quite practical for analysis intensive approaches such as the finite element 
methods; therefore, the crux of this research is to develop excellent approximations for 
MPP identification and also different approximations including the higher-order reliability 
methods (HORM) for representing the failure surface. 

This report is divided into several parts to emphasize different segments of the 
structural reliability analysis and design. Broadly, it consists of mathematical foundations, 
methods and applications. Chapter 1 discusses the fundamental definitions of the 
probability theory, which are mostly available in standard text books. Probability density 
function descriptions relevant to this work are addressed. In Chapter 2, the concept and 
utility of function approximation are discussed for a general application in engineering 
analysis. Various forms of function representations and the latest developments in 
nonlinear adaptive approximations are presented with comparison studies. 

Research work accomplished in reliability analysis is presented in Chapter 3. First, 
the definition of safety index and most probable point of failure are introduced. Efficient 
ways of computing the safety index with a fewer number of iterations is emphasized. 
In Chapter 4, the probability of failure prediction is presented using first-order, second- 
order and higher-order methods. System reliability methods are discussed in Chapter 5. 
Chapter 6 presents optimization techniques for the modification and redistribution of 
structural sizes for improving the structural reliability. 

This report also contains several appendices on probability parameters. 
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CHAPTER 1. PROBABILITY THEORY PRELIMINARIES 


During the last ten years, there has been an increasing trend for analyzing structures using 
probabilistic information of loads, geometry, material properties, and boundary conditions. As 
the structures become more complex (e.g., space shuttle main engine parts, space structures, 
advanced tactical fighters, etc.) and the performance requirements become more ambitious, 
the need for analysis of uncertainties and computation of probabilities grows. 

The reliability of a structure is its ability to fulfill its design purpose for a specified reference 
period. Most structures have a number of possible failure modes. In calculating the structural 
reliability, the influence of multiple disciplines has to be taken into account. Many structural 
problems are modeled and simulated using the finite element methods (FEM) for obtaining a 
detailed structural response. FEM is a computationally intensive numerical procedure with a 
large number of degrees of freedom. With an increase in the complexity of the structural model 
and the multidisciplinary nature of analyses, the number of failure modes and their computation 
increase very significantly. For accurate and efficient calculation of structural reliability, new 
and innovative methods have to be employed to make this performance measure practical in a 
wide variety of structural applications. The structural reliability can be used as a comparative 
measure in choosing among competitive designs. 

In this chapter, basic definitions of probability theory, density function distributions and 

design issues are discussed. 

1.1 Reliability and Its Importance 

Reliability is the probability of a system performing its function over a specified period 
of time and under specified service conditions. Structural response depends on many factors 
such as loads, boundary conditions, stiffness and mass properties. The response is considered 
satisfactory when the design requirements imposed on the structural behavior are met. Each of 
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these requirements is termed as “limit state” or “constraint”. The study of structural reliability 
concerns the calculation and prediction of the probability of limit state violation at any stage 
during its life. The probability of occurrence of an event such as limit state violation is a 
numerical measure of the chance of its occurring. The next goal in this calculation is to improve 
the structural reliability to minimize the risk and failure with the available and allowed design 
alternatives. 

1.1.1 Factor of Safety and Reliability 

Factor of safety is used to maintain a proper degree of safety in structural design. Generally, 
the factor of safety is understood to be the ratio of the expected strength to the expected load. 
In practice, both the strength and load are variables, the values of which are scattered about 
their respective mean values. When the scatter in variables is considered, the factor of safety 
could potentially be less than unity, and the traditional factor of safety based design would fail. 

1.2 Probability Theory Introduction 

An experiment denotes the act of performing something the outcome of which is subject to 
uncertainty and not known exactly. For example, tossing a coin, rolling a die, etc. The sample 
space is the set of all the possible outcomes of the experiment, denoted as S. The sample space 
can be discrete or continuous. An event is the outcome of a single experiment. For example, 
realizing a head on tossing a coin, getting an even number (2 or 4 or 6) on rolling a die. The 
union of two events A and B is written as A U B and is the set of outcomes that belong to 
A or B or both. The intersection of the two events A and B is written as A fl B and is the 
set of outcomes that belongs to both A and B. A null event (empty set) has no outcomes. If 
the occurrence of one event precludes the occurrence of other events in a given experiment, the 
events are called mutually exclusive. The complement of event A is written as A and is the 
outcomes of S which do not belong to A. 


2 



1.2.1 Definition of Probability 


The probability of occurrence of an event E is defined as the ratio of the number of 
occurrences of E to the total number of trials. 


P(E) = Um(^) (1.1) 

where n is the number of trials in which the event E has occurred, and N is the total number 
of trials. Also, 


0 < P(E) < 1 (1.2) 

P(E) = 0 E is impossible (1-3) 

P(E) = 1 E is certain (1-4) 

If A and B are mutually exclusive, 

P(AUB) = P{A) + P(B) (1.5) 

In general, if A and B are any two events, then 

P(A U B) = P(A) + P(B) - P(A D B) (1.6) 

P(A) = 1 - P(A) (1.7) 


1.2. 1.1 Conditional Probability 

Conditional probability of events A and B is the probability of B given that A has occurred. 
It is written as P(B\A). 


P(B\A ) = 


P(A n B) 

P(A) 


From the definition of conditional probability, 


(1.8) 
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P(A f)B) = P(B\A)P(A) 
P(B n A) = P{A\B)P(B) 
Events A and B are said to be independent if and only if 


(1.9) 

( 1 . 10 ) 


P(A n B) = P{A)P{B) 


( 1 . 11 ) 


Example 1.1 

A pair of ordinary dice are thrown. What is the probability of the sum of spots on the 
upward-landing faces being 7 (event A), given that this sum is odd (event B)? 

The sample space is composed of 36 outcomes: 


n = {(1,1), (1,2), (1,3), (1,4), (1,5), (1,6), 

( 2 . 1 ) , ( 2 , 2 ), ( 2 , 3 ), ( 2 , 4 ), ( 2 , 5 ), ( 2 , 6 ), 

(3.1) , (3, 2), (3, 3), (3, 4), (3, 5), (3, 6), 

(4.1) , (4, 2), (4, 3), (4, 4), (4, 5), (4, 6), 

(5.1) , (5, 2), (5, 3), (5, 4), (5, 5), (5, 6), 

( 6 . 1 ) , ( 6 , 2 ), ( 6 , 3 ), ( 6 , 4 ), ( 6 , 5 ), ( 6 , 6 )} 


The number of outcomes favorable to A is 6, so the unconditional probability is 



1 

6 


If B has occurred, then one of 18 events occurred (a “new” sample space with 18 points), 
and the conditional probability is 


PWB) = A = i 


4 



The probability of event B is 


- 1 


1 

2 


and P(A\B ) can also be obtained from Eq.(1.8): 


P(A\B) = 


PjBnA) & 
P(B ) | 


1 

3 


1.2.2 Random Variable 

A random variable X , takes on various values x within the range — oo < x < oo. A random, 
variable is denoted by a capital letter, and its particular value is represented by a lower case 
letter. Random variables are of two types; (i) discrete and (ii) continuous. If the random 
variable is allowed to take only discrete values aq, X 2 , • - • 5 x n , it is called a discrete random 
variable. On the other hand, if the random variable is permitted to take any real value in a 
specified range, it is called a continuous random variable. In this report, we concentrate on 
continuous variables. For example, the yield strength R of steel is a random variable. When R 
is measured in a tensile test, different values are observed for each identically prepared specimen 


0 < R < oo (1-12) 

1.2.3 Probability Density and Cumulative Distribution functions 

The function that describes the distribution of a random variable over the sample space 
of the continuous random variable, X , is called the probability density function (pdf) and is 
designated as fx(x)- The cumulative distribution function (cdf) Fx{x) is an alternate way to 
describe the probability distribution for both discrete and continuous random variables, cdf is 
defined for all values of random variable X from — oo to +oo and is equal to the probability 
that X is less than or equal to a specific value x. 

For a continuous random variable, F x (x) is calculated by integrating the pdf for all values 

of X less than or equal to x: 
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(1.13) 


Fx{x) = l‘ fx(s)ds 
J — oo 

If the random variable X is continuous and if the first derivative of the distribution function 
exists, the probability density function fx{x) is given by the first derivative of F x (x): 

fx(x) = (1-14) 

The cdf is a nondecreasing function of x (its slope is always greater than or equal to zero) 
with lower and upper limits of 0 and 1, respectively, cdf is also referred to in the report as a 
distribution function. A typical probability density function and the corresponding distribution 
function are shown in Fig. 1.1. 

In general, there are n random variables. The outcome is an n dimensional random vector. 
The probability is calculated as 

P[a < X < b,c <Y < d\ = f f fxv(x,y)dxdy (1-15) 

Jc Ja 

Properties : 

fxy{x,y)> 0 (1.16a) 

J s Jfxy{x,y)dxdy= 1 (1.166) 

1 .2.3.1 Joint Density and Distribution Functions 

For independent random variables, the joint density function is given by the product of 
individual or marginal density functions as 


fx u x 2 ,...,x 3 = ... fx n {x n ) 


(1.17) 


6 



0 


(b) Normal distribution function 0>) Exponential distribution function 


Fig. 1.1 Probability Density and Distribution Functions 




The joint distribution function is given as 


Fx u x 3 x n ( x u x 2 , • • • ®n) = Fx 1 (x- 1 ).Fx 2 (x 2 ) ■ ■ . F Xn (x n ) 


(1.18) 


In general, to compute a probability associated with an event involving a multidimensional 
vector whose joint pdf is fx(X), 


P(X en ) = / fx(X)dX (1.19) 

J fi 

This is the probability that the random vector X will lie in region Cl. 

1.2.3. 2 Marginal Distribution of X 

For example, the pdf of X without regard to Y is 

/ OO 

fxv(x,y)dy ( 1 . 20 ) 

-OO 

1 .2.3.3 Conditional Distribution of X given Y 
The pdf of X for a specified Y is 

fx\y(x\y) = fy > 0 ( 1 - 21 ) 

1.2.3. 4 Independent Random Variables 
If X and Y are independent, then, 

fx,y(x,y) = fx(x) ( 1 - 22 ) 

The conditional pdf becomes the marginal pdf, and the joint pdf becomes the product of the 
marginals: 


fxy(x,y) = fx{x)fy{y) 


(1.23) 
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In general, the joint pdf is equal to the product of the marginals when all variables are mutually 
independent: 


M*)=n /*(*■•) f 1 - 24 ) 

1=1 

1.2.4 Mean. Mode and Median 

The probability density or distribution function of a random variable contains complete 
inf ormation about the variable. However, in many cases, the gross properties of the variable 
are used. The most commonly used are the mean and standard deviation. A measure of central 
tendency is captured by the mean value fi of the probability distribution. The variation from 
the mean is captured, to first order, by the variance a 2 and its by products, the standard 
deviation cr and coefficient of variation C x - 
Mean (first moment j: 

The mean value, also termed as the expected value or average, is used to describe the central 
tendency of a random variable. This is a “weighted average” of all the values that a random 
variable may take. If fx(x) is the probability density function of X , the mean is given by 

/ OO 

xf x (x)dx (1.25) 

-OO 

H is the distance to the centroid of the pdf. It is called the “first moment” since it is first 
moment of area of the pdf. The mean is analogous to the centroidal distance of a cross-section. 

According to the definition of a random variable, any function of a random variable is itself 
a random variable. Therefore, if g(x) is an arbitrary function of x, the expected value of g(x) 
is defined as 


E[g(x)] = f°° g(X)f x (x)dx 

J — OO 


(1.26) 
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Mode: 


Mode is the value of X corresponding to the peak value of the probability density function. 
Median: 

Median is the value of X at which the cumulative distribution function has a value of 0.5. 
Higher-Order Moments 

Define the n th order moment by letting Y = X n : 


/ oo 

x n fx(x)dx (1.27) 

-CO 

For n = 2, the mean square value of X is 

/ CO 

x 2 f x {x)dx (1.28) 

-OO 

Properties of Expected Values 
E(cX) = cE(X ) 
where c is a constant. 

Given Y = X\+X 2 + ... X n , the expected value of Y is a linear combination of individual values: 
E{Y) = E(Xi) + E(X 2 ) + ...E{X n ) 

Only if X and Y are independent, 

E(XY) = E(X)E{Y) 

1.2.5 Standard Deviation and Skewness Coefficient 

The expected value or mean value is a measure of the central tendency, which indicates 
the location of the distribution on the coordinate axis representing the random variable. A 
measure of the variability of the random variable is usually given by a quantity known as the 
standard deviation. Another quantity, which not only gives a measure of the variability, but 
also a measure of the symmetry of the density function, is called the skewness coefficient. 
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1.2. 5.1 Standard Deviation 


The variance of a random variable X is as a measure of the degree of randomness about the 


mean 


o% = V(X) = E[(X - tixf] (1-29) 

Geometrically, it represents the moment of inertia of the pdf about the mean value. The variance 
of a random variable is analogous to the moment of inertia of a weight about its centroid. The 
variance or standard deviation is a measure of the variability of a random variable or the 
breadth of the density function. The standard deviation is defined as 


< 7 * = +y/v{X) (1-30) 

The standard deviation is often preferred over the variance as a measure of dispersion because 
it has the same units as X and fi. 

Properties of Variance 

V(X) can also be written as E(X 2 ) — fx\. If c is a constant, V{c + X) = V(X), 
V{Xx +X 2 + ... + X n ) = V(Xx) + V{X 2 ) + ... + V{X n ), only if X t are mutually independent. 
The coefficient of variation is a measure of dispersion in nondimensional form and is defined as 

standard deviation _ ax Q1 \ 

coefficient of variation of X — 

7Tl€-(lTl t~^ X 

1 .2.5.2 Skewness Coefficient 

The expected value of the cube of the deviation of the random variable from its mean value 
(also known as the third moment of the distribution about the mean) is taken as a measure of 
the skewness or lack of symmetry of the distribution: 

E[(X - fix) 3 } = r ( X - vx ) 3 fx(x)dx (1.32) 

J —oo 
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The value of E[(X — /x^) 3 ] can be positive or negative. The skewness coefficient is defined as 


skewness coefficient = 




°x 


1.2 .5. 3 Covariance 


The covariance of two random variables X and Y is defined as 


(1.33) 


/ oo r oo 

/ (x - nx){y~ HY)-fx,Y{ x ,y)dxdy = a X y (1-34) 

-oo J —oo 

By expanding the product, it can be rewritten as 

<j X y = E{XY)-ii x hy (1-35) 

where 

/ oo 

xyfxY{x,y)dxdy (1.36) 

-OO 

If X and Y are independent variables, then axy = 0. The converse is not generally true. If 
ctxy = 0, X and Y are said to be uncorrelated. 

The correlation coefficient px,Y for the random variables is defined as 


, C m (X,Y) ,,,,, 

Px,Y = (1-37) 

<?X-Vy 

and its value lies between -1 and 1. The correlation coefficient is often used to characterize the 
relationship between two variables. The physical meaning of the correlation coefficient is that 
its value is nearly unit if the two random variables are linearly related, but is nearly zero if 
they are not. 


1.3 Probability Distributions 

There are several types of probability distributions for describing random variables. The 
selection of a particular type of probability distribution depends on (i) the nature of the problem, 
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(ii) the underlying assumptions associated with the distribution, (iii) the shape of the curve 
between f(x) or F(x) and x obtained after plotting the available data, and (iv) the convenience 
and simplicity afforded by the distribution in subsequent computations. 

The properties of some of the more commonly used distributions are presented in the 
following sections. 

1.3.1 Normal Distribution 

The density function of a normally distributed random variable X (also known as Gaussian 
distribution) is given by 

/*(*) = — (1-38) 

VZTTCTx * °X 

where X is identified as N(/ix, &x)- The parameters of the distribution fix and ax denote, 
respectively, the mean value and standard deviation of the variable X. The density function 
and the corresponding distribution function are shown in Fig. 1.1. The normal distribution 
has the following properties: 

(i) Any linear function of normally distributed random variables is also normally distributed. 
Let Z be the sum of normally distributed random variables 

Z = cio d" o\ Xi + 0 , 2 X 2 + ... + o n X n (1.39) 

where a,’s are constants. Then Z will be normal, where 

Hz = a Q + ^2 Cz ~\ lZ( a *' <T *) 2 (T40) 

i=l \ i = 1 

(ii) The nonlinear function of normally distributed random variables can be normal, Weibull, 
gamma, lognormal, etc. or example, the function y = yXf + X$ of two independent and 
standard normally distributed random variables X\ and X 2 with iV(0,<r 2 ) is a Rayleigh 
distribution function as shown in Fig. 1.2. Its density and distribution functions are 
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v° 

Fig. 13 Standard Normal Distribution 

and it is symmetric about its mean p = 0 as shown in Fig. 1.3. The distribution function of 
the standard normal variate Z is commonly denoted as $(z) and is given by 

$(z) = F z {z) = J ^ -j==exp[-^-]dz (1.43) 

If <h(zp) = p is given, the standard normal variate z p corresponding to the cumulative probability 
(p) is denoted as 

z p = <fr\p) (1.44) 

The values of the distribution function $(z) of a standard normal variate are given as tables 
of normal distribution (Ref. [4]). Usually, the possibilities are given in tables only for positive 
values of z and for negative values 
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«(-*) = !-$(«) 


(1.45) 


due to the symmetry of the density function about zero. Similarly, we can find that 

2p = $- 1 (p) = -$- 1 ( 1 — p) (1.46) 

Once the standard normal table of $( 2 ) is available, the probabilities of any other normal 
distribution can be determined using the following procedure. For a nonstandard X with 

N(n,cr) 


P{£ < X < u) = X= r - f exp[-h- — —f).dx (1.47) 

V27r<7 h 2 ax 

This represents the area under the density function between £ and u. By defining a new variable 
(standard normal variate) z as 


x — n 

z — 

a 

then 

dz = — (1.48) 

a 

and the probability becomes 

1 Luziel -2 

P(£<X <u) = -j= exp[——).dz (1.49) 

which can be recognized as the area under the standard normal density function between ( - ) 
and (^)- Thus, the required probability can be found as 

P(£<X < u) = *(2-^) - *(^) (1-50) 
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1.3.3 Lognormal Distribution 

A random variable X is said to follow lognormal distribution (Fig. 1.4) if Y = InX follows 
normal distribution. Thus, 


Since Y = InX the above equation can be rewritten in terms of A as 


(1.51) 


c f \ 1 r 1 , In x- fly 2 

/(x) = ^W ei?h 2 ( -^T _)1 "- 0 


where 


(1.52) 


and 


4 = M (— ) 2 + 1 ] 

Mx 


My = In — 2 °Y 


(1.53) 


(1.54) 


1.3.4 Weibull Distribution 


The probability density function (Fig. 1.5) is 


.a— 1 


/vt* u ** nr 

x>0,a>0„9>0 


and the distribution function cdf is 


(1.55) 


F x (x) = 1 - exp[—(—) a ] 

This is a two parameter family, a and (3. The moments in terms of the parameters are 


(1.56) 


E(x n ) = p n r(- + i) 

a 

where T(.) is the gamma function. The mean and coefficient of variation are 


(1.57) 
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(1.58) 


MX =W- + 1) 

a 


Cx = . 


ia+i) 

r 2 ^ + 1) 


- i ] 0 - 5 


(1.59) 


The mean and standard deviation are complicated functions of the parameters. However, the 
approximation, a = C* 108 is a very good one (over the range of interest to engineers). The 
following parameters are recommended in Ref. [6]. 


O = CJ' 08 fi = (1-60) 

1.3.5 Exponential Distribution 

This is a special case of Weibull distribution for a = 1. The pdf is 


The cdf is 


fx{x) = \exp[—Xx] x > 0 
= o otherwise 


(1.61) 


Fx(x) = 1 — exp[—\x] 


The moments in terms of the parameter A are 

1 1 

* = A a * = A 


(1.62) 


(1.63) 


The exponential is commonly used in reliability analysis. If time to failure T of a unit has 
an exponential distribution, A represents failure rate (occurrences/time). This is commonly 
used in electrical engineering and is occasionally used in design, e.g., long-term distribution of 
fatigue stresses. 
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Fig. 1.6 Exponential Density Function 



Fig. 1.7 Extreme Value Density Function (Type I) 
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1.3.6 Extreme Value Distribution-Type I Distribution of Maxima 


The cdf is 


Fx(x) = exp[— [exp{— a(x — /?)}]] (1-64) 

The parameters are a and /3. The mean and standard deviation in terms of a and /3 are 


Px ft 


0.577 

a 


= — (1-65) 

a 

Typical examples of extreme value distribution are to describe loading such as: 

(i) the random variable describing the peak gust velocity experienced by an aircraft in very 


long hours of operation, and 

(ii) The random variable denoting the maximum water level in a year at a point in a stream. 


1.4 Choice of a Statistical Model 


1.4.1 Normal Distribution 

For small coefficients of variation this can be used. Examples are modulus of elasticity, 
Poisson’s ratio, material properties, etc. 

1.4.2 Lognormal Distribution 

This can be used for most variables and plays an important role in probabilistic design. 
Examples are cycles of failure in fatigue, material strengths, loading variables, etc. 

1.4.3 Weibull Distribution 

This is a very popular distribution, but it is probably over used. Examples are fatigue, 
material strength, time to failure in reliability analysis, and long-term distribution of stress 
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ranges in fatigue. 

1.4.4 Extreme Value Distribution 

Type I of maxima is used almost exclusively for extreme environmental (load) variables. 

1.5 Normal Variables - Linear Response Function 

For a response function Z of the form 

Z = a 0 + itaiXi (1-66) 

:=1 

where a, are constants and the random variables X, have normal distribution with a mean of 
fii and standard deviation of cr,, Z is also normal (for any n). The mean and standard deviation 
of Z are 


n 

fJ-Z = <*0 ” 1 “ ^ ^ ifti 

i=l 


°z — 


A 


;<•?«? 


i=i 


1.6 Lognormal Variables - Multiplicative Response Function 


(1.67) 

( 1 . 68 ) 


For a response function Z of the form 

Z = a 0 f[Xr (1-69) 

1 = 1 

where a, are constants and the random variables X, have lognormal distribution with a median 
of Xi and coefficient of variation Cx r It is more convenient to use the median and coefficient 
of variation as the basic parameters for lognormal variates. 

The resulting response function Z is also lognormally distributed with median, 


( L7 °) 

t=i 
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and the coefficient of variation 


C v 


N 


II(i + cj,)-; - 1 


i= 1 


1.7 Uncertainties in the Design Process 


(1.71) 


1.7.1 Strength or Resistance fRf Uncertainties 

(i) The exact strength properties of the material are unknown. 

(ii) The size effects are not accurately known. 

(iii) The effects of machining and processing operations on the strength are not known. 

(iv) There is uncertainty of the effect of the assembly operations on the strength of the system. 

(v) The effect of time on the strength is not known. 

1.7.2 Stress or Loading (S) Uncertainties 

(i) The assumptions used in modeling and stress analysis contain errors. Discontinuities and 
stress concentrations are often ignored in the analysis. 

(ii) The magnitude of the peak loads are not exactly known. 

1.8 Probabilistic Design 

Probabilistic and statistical methods are convenient tools to describe or model physical 
phenomena that are too complex to treat with the present level of scientific knowledge. 
Probabilistic design procedures promise to improve the product quality of engineering systems 
for the following reasons. Probabilistic design explicitly incorporates given statistical data into 
the design algorithms, whereas conventional design discards such data. Rational comparisons 
can be made between two or more competing designs for a proposed system. In the absence 
of other considerations, the engineer chooses the design having the lowest failure probability. 
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Probabilistic based information on mechanical performance can be used to develop rational 
policies towards pricing, warranties, spare parts requirements, etc. 


1.9 Summary 

In this chapter, basic definitions of probability theory and distribution functions were 
introduced. Further details and explanations can be found in the text books cited in this 
chapter. In this report, only the definitions and terminology relevant to the following chapters 
were presented. 


* 
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CHAPTER 2. FUNCTION APPROXIMATION TOOLS 


Function approximations have been playing a major role in optimization of large scale 
structures during the last two decades. Since their inception in the 1970s by Schmit and Farshi 
[1], they have found an important place in the research, implementation and technology transfer 
of many structural optimization algorithms. For many structural optimization problems, the 
evaluation of the objective function and constraints requires the execution of costly finite 
element analyses for displacements, stresses or other structural responses. The optimization 
•process may require evaluating the objective function and constraints hundreds or thousands 
of times. The cost of repeating the finite element analysis so many times is usually prohibitive. 
However, this computational cost problem can be addressed by the use of approximations during 
portions of the optimization process. First, an initial design is obtained by using an exact 
analysis, and the information needed in constructing the approximations is generated. The 
original optimization problem is changed into a sequential approximate optimization problem 
with approximate constraints. Then, the approximate problem is solved by an optimization 
algorithm. The objective function value is obtained at the optimum solution and compared with 
the initial value. If the convergency is not satisfied, the process is repeated until convergence. 
Since the approximation has replaced the expensive exact constraint calculations, significant 
computational savings can be realized, particularly for the large scale structural problems 
requiring time-consuming analyses. 

Probabilistic structural analysis is an inherently computationally intensive procedure, and 
the problem is exacerbated by the convergence difficulties associated with highly nonlinear 
and large scale structural problems. To alleviate this problem, many approximate reliability 
methods have been developed within the past two decades. A commonly used approximate 
approach is to use uncertainties information represented by only the first two moments 
(mean and standard deviation) and change the original probability model (multidimensional 
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integration over an irregular region) into a safety index problem. This safety index problem is 
actually an optimization problem of finding a point on the structural response surface which has 
the shortest distance from the origin to the surface in the standard normal space. Therefore, the 
approximation approach in optimization can be applied to solve the safety index. Furthermore, 
the probability is computed based on the safety index information and the approximations 
of the limit state surface. According to different approximations of the surfaces, different 
probability methods are generated, such as the first-order reliability method (FORM), second- 
order reliability method (SORM) and higher-order reliability method (HORM). 

Most of the approximations presented in the literature were based on function and gradient 
information at a single point and constructed by using the first-order Taylor series expansion 
about this point. This method is very popular because the function and its derivative values 
axe always needed for the search direction calculation, so no additional computation is involved 
in developing an approximate function. There axe several variations of first-order Taylor 
series approximations, most notably the linear, reciprocal and conservative approximations. 
These approximations work effectively for stress and displacement type problems; however, the 
truncation error of the first-order approximation might be laxge and could be inaccurate, even 
for design points closer to the expansion point. The accuracy of the first-order approximations 
may be increased in some disciplines by retaining higher-order terms in Taylor series expansion, 
such as the quadratic approximation. This requires the calculation of higher-order function 
derivatives that may not be available analytically. 

Both the above first-order and higher-order approximations are formed by using the first- 
order and higher order Taylor series expansion, respectively, in terms of direct and reciprocal 
design variables. The intervening variables are fixed in these approximations. For example, 
the linear approximation can be considered as the first-order Taylor series expansion in terms 
of the intervening variables yi = X;. The reciprocal approximation is the first-order Taylor 
series expansion in terms of the intervening variables y,- = T-. As we know, for the truss 
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structures with stress and displacement functions, using the reciprocal intervening variables 
can dramatically improve the approximation accuracy. However, the use of fixed intervening 
variables is difficult to adopt for different problems, and selection of the intervening variables 
is also quite difficult and requires tremendous experience and knowledge. Therefore, the use of 
adaptive intervening variables for different types of problems is necessary. 

Furthermore, both the first-order and higher-order Taylor series approximations are based 
on a single point. As the structure is being resized, new approximations are constructed at new 
design points. In this approach, previous analyses’ information is discarded and not used to 
improve the later approximations. Recently, more accurate approximations have been developed 
by using more than one data point, such as two points, three points or more. These multi-point 
approximations use current and previous information to construct approximations. Since more 
information about the function values and gradients at the known points are provided, the 
multi-point approximation is usually able to automatically adust its nonlinearities by itself. 
Therefore, the multi-point approximations are adaptive and provide better accuracy than the 
single point approximations. Also, no higher-order gradients are needed in constructing the 
approximations. 

In this chapter, the use of approximations and advantages are discussed in Section 2.1. 
The availability of gradients is given in Section 2.2. The approximations constructed based 
on a single point are introduced in Section 2.3, which includes the three most commonly- 
used approximations (linear, reciprocal, and conservative approximations). The two-point 
approximations which were developed in Wang and Grandhi’s earlier work are given in Section 
2.4, which includes the two-point adaptive nonlinear approximation (TANA) and improved two- 
point adaptive nonlinear approximation (TANA2). The multi-point Hermite approximation 
is introduced in Section 2.5. The approximation comparisons of various approximations are 
discussed in Section 2.6. The relevant references for the approximations are listed in Section 
2.7. 
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2.1 Use of Approximations and Advantages 


As mentioned above, the function approximations are particularly useful when the 
computational cost of a single evaluation of the object functions, constraints, and their 
derivatives is very large compared to the computational cost associated with the optimization 
operations, such as the calculation of search directions. A typical situation is when a finite 
element model with thousands of a degrees of freedom is used to analyze a structural design 
that is defined in terms of a handful of design variables. It then pays to reduce the number of 
exact structural analyses required for the design process by applying optimization algorithms 
to a model of the structure based on approximations. 

In general, the optimization problem is stated as 

Minimize f{X) (2.1a) 

Subject to: Gj{X)< 0, (j = 1, 2, ..., J) (2.16) 

xf < x, < xf (i = 1,2, ...,1V) (2.1c) 

where X represents the vector of design variables, f(X) is the objective function, Gj(X ) is 
the jth behavior constraint, and xf and xf are the lower and upper limits on the *th design 
variable, respectively, and J and N denote the number of behavior constraints and design 
variables, respectively. 

Based on the approximations, such as linear, reciprocal, conservative, two-point adaptive 
nonlinear, multivariate Hermite, etc., the original optimization problem of Eq. (2.1) is changed 
into a sequence of explicit approximate problems as follows: 

Minimize f^ k \X) = f(X) (2.2a) 

Subject to: G k j{X) = Gj(X) < 0, (j = 1,2,..., J) 


xf < Xi < xf 
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(* = 1,2,..., N) 


(2.26) 

(2.2c) 



where k is the iteration number. 

Because of the approximation involved, exact function evaluations are avoided in solving 
(2.2a) and (2.2b), and computational savings are realized. Only at the convergent solution 
of the problem (2.2), exact objective and constraint function calculations are needed, and the 
approximations based on the information of the convergent point are constructed. The process 
is repeated until convergence. 

However, the approximations may result in significant errors if the nonlinearities of the 
approximation are not closer to those of the original objective and constraint functions. 
Due to inaccurate approximations, optimization algorithms may be difficult or may never 
converge without a proper choice of move limits. To avoid this problem, constructing accurate 
approximations is very important. 

In summary, the approximations play an important role in the optimization of large-scale 
or complex structures. The approximations can reduce the high computational cost required 
in evaluating objective function and constraints hundreds or thousands of times. Also, the 
approximations are able to transfer the analysis package into the optimization program when 
the structural analysis program is large, or if the analyst does not have access to the source 
code of the program. 

2.2 Availability of Gradients and Their Use 

An important task in optimal design is to obtain sensitivity derivatives, which are used for 
studying the effect of parametric modifications, calculating the search directions for finding an 
optimum design, and constructing function approximations. The calculation of the sensitivity 
of structural response to changes in design variables is often the major computational cost of 
the optimization process. For a simple truss problem with n design variables, computing the 
first-order gradients in terms of all the design variables requires n FE analyses. Computing the 
gradients of constraint functions will be very expensive if the problem has a large number of 
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design variables. Also, for some complex problems, the sensitivity analysis may not be easily 
computed. The approximate gradients information has to be used for optimization. 

One commonly used technique for calculating derivatives of response with respect to a 
design variable is the finite-difference approximation. This technique requires only the function 
estimations, so it is very useful when the exact derivatives are difficult to determine. However, 
the finite- difference is often computationally expensive and has accuracy problems. 

Use of approximations is an efficient way to obtain the sensitivity derivatives. Once 
the approximation is constructed, the derivatives can be easily calculated from the explicit 
functions. If the approximation is closer to the original function at the design point, it provides 
good sensitivity estimations at the point. Also, no extra exact analyses are needed in computing 
the derivatives. 

2.3 One-point Approximations 

In this section, several one-point approximations (linear, reciprocal and conservative) are 
introduced. One-point approximation means that the approximation is constructed based on 
the function value and gradients information of one point. Usually, this point is selected as 
the most current point in the iteration process. The most commonly used approximations of 
objective and constraint functions are based on one-point information, z.e., the function and 
its first derivatives at a single design point. 

2.3.1 Linear Approximation 

The simplest approximation is the linear approximation, which is a first-order Taylor series 
expansion at a design point X\\ 

ff(X) — 9(Xi) + XI “ ^ ^ -(ij — Xj,i) (2.3.1) 

«=i OXi 

where x, is the i th component of variables X and x,-,i is the i th component of the known point X\ . 
This approximation is very popular since the function and its derivatives are needed in search 
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direction calculation, and no additional computation is involved in developing the approximate 
function. However, for many applications the linear approximation is inaccurate even for design 
points X that are close to X\ . Accuracy can be increased by retaining additional terms in the 
Taylor series expansion, but it requires the costly calculation of higher-order derivatives. A 
more attractive alternative is to find intervening variables that make the approximate function 
more linear. One of the popular intervening variables is the reciprocal of which makes the 
following reciprocal approximation. 


2.3.2 Reciprocal Approximation 


The reciprocal approximation is the first-order Taylor series expansion in the reciprocals of 
the variables yi = l/x t (i = l,2,...,n). It can be written in terms of the original variables Xf. 


j(x) = »(xo+E^l( *-*«)(**) 


(2.3.2) 


This approximation has been proven efficient for truss structures with stress and displacement 
constraints because in statically determinate structures, stress and displacement constraints 
are linear functions of the reciprocals of the design variables X. 

However, there is one problem in the reciprocal approximation given in Eq. (2.3.2). The 
approximation becomes unbounded when one of the variables approaches zero. A modified 
approximation was presented by Haftka, et al in Ref. [2], which is 


9m(X) = g{X 2 ) + Y Q x ~~ ( x * “ Xmi _|_ x . ) 


(2.3.3) 


where X 2 is the current point. The values of x mi were evaluated by matching with the derivatives 
at the previous point X\ , that is 


dg(*i) / 3Cmi “H »Ei,2 \ 2 dg(Xi) 

Xfjii H - X{,\ dxi 


or 


Xmi — 


r]z - 1 


(2.3.4) 


(2.3.5) 
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where 


When the ratio of the derivatives is negative, the derivatives at the previous point X\ are not 
matched. In that case, x mi is set to a very large number, so that the linear approximation is 
used for the ith variable. 

This modified reciprocal approximation is a two-point approximation because two-point 
information is used to construct the approximation given in Eq. (2.3.3). 


2.3.3 Conservative Approximation 

Conservative approximation, as presented by Starnes and Haftka, 1979 in Ref. [3] is a 
hybrid form of the linear and reciprocal approximations and is more conservative than both. 
The approximation is given as 

g(X) = g(X i) + y) C,— ^ -(^i — (2.3.7) 

*=i OXi 


where 


C, = 


X|,l 


*"/ ^ 


(2.3.8) 


' 1 otherwise 

In the above approximation, C, = 1 corresponds to the linear approximation, and C t = x, t i/xj 
corresponds to the reciprocal approximation. 

The conservative approximation is not the only hybrid linear-reciprocal approximation 
possible. Sometimes physical considerations may dictate the use of linear approximation for 
some variables and the reciprocal for others. However, as can be easily checked, the conservative 
approximation has the advantage of being convex. If the objective function and all the 
constraints are approximated by the conservative approximation, the approximate optimization 
problem is convex. Convex problems are guaranteed to have only a single optimum, and they 
are amenable to treatment by dual methods. 
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2.4 Two-point Adaptive Nonlinear Approximations 


In this section, several two-point approximations are introduced. These approximations 
were presented by Wang and Grandhi in Refs. [4 - 6]. Two-point approximation means that 
the approximation is constructed based on the function values and gradients information of two 
points. Usually, one is selected as the most current point and another is the previous point in 
the iteration process. 

Adaptability represents the capability of automatically matching the nonlinearity of various 
functions. For one-point approximations, the nonlinearity of the approximations is fixed since 
the intervening variables are fixed. In general, selecting appropriate intervening variables 
is extremely difficult for different engineering problems. For the stress and displacement 
constraints of the truss structures, the reciprocal approximation can yield accurate results 
by using the reciprocals of the design variables. However, these reciprocal intervening variables 
may not be good for other constraints of truss structures or other structures. For practical 
engineering problems, the use of fixed intervening variables is difficult to adopt for different 
constraints, and selection of the intervening variables is also quite difficult and requires 
tremendous experience and knowledge. Therefore, the use of adaptive approximate models 
or changeable intervening variables for different types of problems is necessary. The following 
two-point approximations are capable of adjusting their nonlinearities automatically by using 
two-point information. 

2.4.1 Two-point Adaptive Nonlinear Approximation (TANA) [4] 

TANA is a two-point adaptive approximation and was presented by Wang and Grandhi in 
Ref. [4] using adaptive intervening variables. The intervening variables are defined as 

»! = *;, * = 1,2. (2.4.1) 

where r represents the nonlinearity index, which is different' at each iteration, but is the same 
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for all variables. The nonlinearity index was determined by matching the function value of the 
previous design point; that is, r is numerically calculated so that the difference of the exact 
and approximate g(X ) at the previous point X\ becomes zero, 


s(jc.) - {<>(**) + = 0 


(2.4.2) 


i= 1 


r can be any positive or negative real number (not equal to zero). The two-point adaptive 
nonlinear approximation (TANA) is 


-/•tTN (Y'l I 1 Y"' l-r^SiXi) , r T \ 

9 \X) - g{X 2 ) + - 2^ x i,2 q x . v x «' ~ x i, 2 ) 


r :=i 


(2.4.3) 


This approximation has been extensively used in truss, frame, plate and turbine blade structural 
optimization and probabilistic design. The results presented in Refs. [4 - 6] demonstrate the 
accuracy and adaptive nature of building a nonlinear approximation. 

Another two-point approximation, Two-point Exponential Approximation (TPEA) [7], is 
similar to the above TANA. The TPEA method has N different nonlinear indices, p t , for each 
variable and matches the derivatives of exact and approximate function values at the previous 
point to evaluate p,, while TANA matches only the function values of exact and approximate 
calculations at the previous point for finding r. The TPEA method uses the derivative values 
at two points and the function value at the current point, while TANA uses the function values 
at two points and the derivative values at the current point. To utilize more information in 
constructing a better approximation, the TANA1 and TANA2 combine TANA and TPEA and 
produces improved approximations. In TANAl and TANA2, both function and derivative 
values of two points are utilized in developing the approximations. 
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2.4.2 Improved Two-point Adaptive Nonlinear Approximation(TANAl') [6] 


The intervening variables given in Ref. [7] are used, that is, 


Vi = 


i = 1,2 


(2.4.4) 


y\ /V \ | ( T Pi r Pi \ | „ 

g{X) - g{X i) + 2^— ~ \ x i _x i,i) + £ i 

»=i ux > 


(2.4.5) 


where pi is the nonlinear index, which is different for each design variable. The approximate 
function is assumed as 

,i-p< 
lid- 

Pi 

where E\ is a constant, representing the residue of the first-order Taylor approximation in 
terms of the intervening variables yi (y, = ref’). Unlike the other two-point approximations, 
this approximation is expanded at the previous point X\ instead of the current point X 2 ■ The 
reason is that if the approximation was constructed at X?, the approximate function value 
would not be equal to the exact function value at the expanding point because of the correction 
term £\. In actual optimization, to obtain more accurate predictions closer to the current point, 
X\ is selected as the expansion point. The approximate function and its derivative values are 
matched with the current point. 

By differentiating Eq. (2.4.5), the derivative of the approximate function with respect to 
the ith design variable 2 , is written as 


dg{X) _ , xj 1 dgjXi) 

dxi x t) i dx i ’ 

From this equation, p t can be evaluated by letting 
approximation derivatives at this point, that is 


i = l,2,...,n (2.4.6) 

the exact derivatives at X 2 equal the 


dg{X2) _ dg{X2) = » = ( 2 . 4 . 7 ) 

dxi dxi ' 2 t ',i dxi 

where p, can be any positive or negative real number (not equal to zero). Eq. (2.4.7) has n 
equations and n unknown constants. It is easy to solve because each equation has a single 
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unknown constant p,. Here, a simple adaptive search technique is used to solve them. The 
numerical iteration for calculating each pi starts from p,=l. When p, is increased or decreased 
by a step length (0.1), the error between the exact and approximation derivatives at X 2 is 
calculated. If this error is smaller than the initial error (e.g. corresponding to p, = 1), the 
above iteration is repeated until the allowable error (0.001) or limitation of p, is reached, and 
Pi is determined. Otherwise, the step length of pi is decreased by half, and the above iteration 
process is repeated until the final p, is obtained. This search is computationally inexpensive 
because Eq. (2.4.7) is available in a closed form and is easy to implement. 

Eq. (2.4.7) matches only the derivative values of the current point, so a difference between 
the exact and approximate function values at the current point may exist. This difference is 
eliminated by adding the correct term, £ 1 , in the approximation. £1 is computed by matching 
the approximate and exact function values at the current point: 


e. = g(X,) - {«(*.) + i - <i» 

i=l U'Ei Pi 


(2.4.8) 


£1 is a constant during a particular iteration. This method is simple and more importantly the 
new approximation function and derivative values are equal to the exact values at the current 
point. 


2.4.3 Improved Two-point Adaptive Nonlinear Approximation (TANA2) [6 


TANA2 uses the intervening variables given in Eq. (2.4.4). The approximation is written 
by expanding the function at X 2 : 


HX) = g(X 2 ) + ±W^$L.( X ? - *» ) + - xfi) 2 


~i Pi 


(2.4.9) 


1=1 


This approximation is a second-order Taylor expansion in terms of the intervening variables 
Vi (yi — rf' ), in which the Hessian matrix has only diagonal elements of the same value £ 2 . 
Therefore, this approximation doesn’t need the calculation of the second-order derivatives. 
Unlike the original second-order approximation, this approximation is expanded in terms of the 
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intervening variables y,, so the error from the approximate Hessian matrix is partially corrected 
by adjusting the nonlinearity index p , ■ In contrast to the true quadratic approximation, this 
approximation is closer to the actual function for highly nonlinear problems because of its 
adaptability. Eq. (2.4.9) has n + 1 unknown constants, so n + 1 equations are required. 
Differentiating Eq. (2.4.9), n equations are obtained by matching the derivatives with the 
previous point X \ : 


+ £2 ( x * _ xf; 2 )x?rV. 

OXi Xi '2 CfXi 


i = 1,2, ...,n 


(2.4.10) 


Another equation is obtained by matching the exact and approximate function values with the 
previous point X\, that is 


<v\ <v\ i V' dg{X 2 ) x) 2 Px 1 vv pi _ T Pi 

g(X i) = g(X 2) + 2 _s “ \ x i, 1 — x i, 2) + 9 £ 2 l^,( X i, 1 X i,2J 

t=l Pi ^ - - 


(2.4.11) 


1=1 


There are many algorithms for solving these n •+- 1 equations as simultaneous equations. Again, 
a sim ple adaptive search technique is used. First, e 2 is fixed at a small initial value (0.5), 
the numerical iteration described in Section 2.4.2 is used to solve each p,, and the differences 
between the exact and approximate function and derivative values at X| are calculated. Then, 
£2 is increased or decreased by a step length (0.1), p t , and the differences between the exact 
and approximate function and derivative values at Xi are recalculated. If these differences are 
smaller than the initial error (e.g. corresponding to e 2 — 0.5), the iteration is repeated until 
the allowable error (0.001) or limitation of e 2 is reached, and the optimum combination of e 2 
and pi is determined. 

In the TANA2 method, the exact function and derivative values are equal to the approximate 
function and derivative values, respectively, at both points. Therefore, this approximation is 
more accurate than others. 

2.5 Multi-point Hermite Approximation 


In the literature, the Hermite interpolation scheme is presented for a single variable by using 
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multiple data points. In this work, this concept is extended for multi- dimensional problems. 
The advantage of using Hermite interpolation is that it makes use of both function and 
derivative information in building the approximation. The interpolating polynomial retains the 
same function and derivative values as the original information at each of the known data points. 
The Hermite p-point formula gives accurate results when the function to be approximated is 
identified with any polynomial of degree not exceeding 2p — 1 [8]. This approximation can be 
applied for large scale problems with hundreds of design variables because the approximation is 
constructed only by simple algebraic calculations. Mathematical details of this approximation 
are described below. 

For a univariate function f(x ), assuming that the values of the function and first-order 
derivatives at p different points x, (z = 1,2, ...,p) are y, = /(x,) and y[ = f'(xi), the Hermite 
interpolation formula can be given as in Ref. [8] : 

f{x ) = + [y'i ~ 2y i h' i (x i )](x - x,)}6, 2 (x) (2.5.1a) 

«=i 


where 


M*) = fl 


j=1j¥< Xi 


K( x i) = £ 


1 


1 ‘-L Xi — Xj 

At each point of x^ (i=l,2,...,p), /(x) satisfies 


(2.5.16) 


(2.5.1c) 


f(xi) = y, (2.5.2a) 

/'(*«• ) = y'i (2.5.26) 

To construct a multivariate Hermite approximation, the above Eqs. (2.5.1b) and (2.5.1c) 
can be extended for n variables as 


hi(S) 


x (5 - s,-m - sa 
Jh. (S. - s.HSi - Si) 


(2.5.3a) 
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(2.5.34) 


... ,dk,(S) dk^S) dh,(S) , T 

\/h t {S) — l Q ’***’ -I 


dhi(S) 


= hi(s) £ 


d Sl ’ ds 2 ’ 
•Sfc.t - -Sfc,i 


fori 


k = 1,2, ..., n 


(2.5.3c) 


0** 

where 5 is a vector of {sj, s 2 , ..., s„}, which can represent original variables or intervening 
variables, n is the number of variables, and Sk,i represents k th variable of the ith data point. 

Using Eqs. (2.5.3a), (2.5.3b) and (2.5.3c), the one-dimensional Hermite interpolation given 
in Eq.(2.5.1a) can be extended as the following multivariate Hermite expression: 


f(S) = £{?($) + lvs(5.) - MS,) v MSi)] T (S - 


(2.5.4) 


t=l 


where g(Si) and \Jg(S t ) are the function value and gradient vector at the ith known point, 
respectively. ^hi(Si) is obtained by substituting S t into Eq. (2.5.3c), in which h f -(5<) becomes 
1 (proof is given in Appendix A). 

Differentiating Eq. (2.5.4), a gradient formula of the function approximation can be obtained 


as 


Vf{S) - 5z{ 2/l »( 5 ') V h*(S){g(Si) + [V-SK^i) - 2 g{Si) V hi(Si)] T (S - Si)} 

i = 1 ^ 

+h](S)lvg(Si) - 2 g(Si) v MS,-)]} (2-5-5) 

Unlike the two-point Hermite approximation presented in [2], the multivariate Hermite 
formula given in Eq. (2.5.4) reduces to the one- dimensional Hermite interpolation given in 
Eq.(2.5.1a) when n = 1. Furthermore, Eq. (2.5.4) can be used for multiple point approximation, 
not just limited to only two points. The two-point Hermite approximation in [2] is based on 
projection of a point onto the line connecting the two known points. The function f(X ) is 
first approximated by a cubic Hermite polynomial at the projection point, and then linearly 
extrapolated to the test points. It can be used only for two-point approximations because 
the cubic polynomial is derived from two-point Hermite formula of Eq. (2.5.1a). The present 
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p-point n-dimensional Hermite formula is an explicit function with a 2p — 1 polynomial degree, 
which possesses the same value and the same derivatives at each of the p data points as the exact 
function. The demonstration of this characteristic is given in Appendix A. The nonlinearity 
of the Hermite approximation will change as the number (p) of the known points increases 
because it is a function with a 2p — 1 polynomial degree. In order to control the nonlinearity 
and make the constructed approximations closer to the actual nonlinear functions, two types 
of intervening variables are given below. 

2.5.1 Preselected Intervening Variables 

Usually, fixed types of intervening variables are selected in terms of element properties of 
the actual problem. For example, for truss structures with stress and displacement constraints, 
the intervening variables can be assumed as the reciprocal of the physical variables so that 
the behavior functions are fairly linear. For frame structures with displacement constraints, 
the reciprocal section properties can be selected as the intermediate variables [9]. It has been 
demonstrated that the function approximations obtained by selecting appropriate intermediate 
design variables and then expanding using the Taylor series are closer to the actual constraints 
for some of the structural elements. 

The preselected intervening variables can be written as 

s k = T k {X ) k = l,2...n (2.5.6) 

in which T k (X) is a function of original variables, X. For truss and frame structures, T k { X) = x T k 
is an example. The value r represents the preselected nonlinearity in terms of variables X. For 
the above mentioned structures, r = — 1 is often used in the Taylor series expansion. For the 
present Hermite approximation, the value of r can be controlled by 

(2p-l)r = r 0 (2.5.7) 

where ro represents the actual nonlinearity in terms of variables T(X). Eq. (2.5.7) makes 
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the nonlinearity of the constructed approximation have the same nonlinearity as the actual 
function. 

Many researchers have shown that the selection of appropriate intervening variables 
improves the quality of approximations; however, they require experience and knowledge. Often 
finding intervening variables is extremely difficult for some complex multidisciplinary problems. 
Therefore, use of an automated adaptive intervening variables calculation for certain classes of 
problems such as aeroservoelasticity, structural control, probabilistic analysis, etc. is necessary 
where the relationships are not transparent. 

2.5.2 Adaptive Intervening Variables 

Adaptive intervening variables are denoted as S = (si,S 2 , ...,s n ) T . 

s k = x r k fc = l,2, ...,n (2.5.8) 

where Xk ( k = 1,2, ...,n) are the original design variables, and r represents the nonlinearity 
index, which is different at each iteration, but the same for all variables. In order to determine 
this index, a feedback formula based on multiple point information is established as follows. 
Let the value of approximate function f(S) given in Eq. (2.5.4) at the remaining one point (a 
known point except p of the earlier used points), for example Y equal the value of the exact 
function g(Y) at this point, that is 

f(S(Y)) = g(Y) (2-5.9) 


where Y is a selected point for comparing Hermite approximation and computing the r value. 
The most recent data point is used for computing the r value so that the function behavior 
around the current design vector is represented. Using Equations (2.5.3), (2.5.4) and (2.5.8), 
the nonlinearity index can be obtained from the following multi-point feedback formula: 


*(5(r)) - {EWW) + ; t ■ (Vi - *;,)} 
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(2.5.10) 


*?CS(K))} = 

where dhi(S(Xi))/dx k can be obtained from 


0 


dhi(S) r^dhiiS) 

= rxi 


(2.5.11) 


dx k * ds k 

The nonlinearity index r is numerically solved. Equation (2.5.10) may result in more than 
one root, either positive or negative. The r value closest to unity is taken as the root because 
the intervening variables resemble the original variables, and no additional effort is needed for 
finding the intervening variables. 

Similarly, the derivatives of f(S) with respect to original variables x k can be obtained as 


MS) _ f(S) 

= rxi 


dx k 


ds k 


(2.5.12) 


2.6 Approximation Comparisons 

Several examples axe selected to compare the accuracy of the approximations introduced 
above. The relative and absolute errors are calculated as follows: 


. Exact — Approximation 

Relative Error — — 

Exact 


Absolute Error — Exact — Approximation 


(2.6.1a) 

(2.6.16) 


The examples include explicit and implicit constraint functions. The constraint function of 
the 313-member frame structure requires a finite element analysis. In all of the examples, the 
test points are derived using 

X = X 0 + a s D (2.6.2) 


where Xq is an initial point, which is defined as the expanding point for all the approximations 
except TANA1 and Hermite. Instead, it is defined as the matching point for TANAl and 
Hermite. a s is a step length, and D is a direction vector which is selected as D = {1,1,1,1...} T 
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for case 1, D = {-1,1, -1,1, ...} r for case 2, D = {1, 0, 1, 0,...} T for case 3, and D = {0, 1,0, 1, 
...} T for case 4. 


Example 2.1 

This example is taken from Ref. [10], and the constraint function is defined as 


, 10 30 15 2 25 , 108 40 47 

g(X) = — + s+ — + S + — + — + — + — - L0 

’ X\ x\ x 2 xf x 3 X| x 4 x% 


All of the approximations except TANA1 and Herimite are expanded at the point A 2 (l, 1, 1,1),. 
and the previous point is selected as .^(1.2, 1.2, 1.2, 1.2). TANA1 is expanded at X x and 
matched with the values at AT 2 . The nonlinearity index r for the Hermite approximation 
with adaptive intervening variables is determined by matching the function value at A 2 . The 
two-point Hermite approximation is based on X(0. 5, 0.5, 0.5, 0.5) and X(l. 2, 1.2, 1.2, 1.2). The 
three-point Hermite approximation is based on X(0. 5, 0.5, 0.5, 0.5), ^(0.75, 0.75, 0.75,0.75) and 
X(1.2, 1.2,1.2, 1.2). The relative errors of several methods for four cases are plotted in Figs. 
2.1a, 2.1b, 2.1c and 2.1d for four cases. Fig. 2.1a shows that when design variables are 
changed along the same direction as X\ and X 2 points (case 1), the two-point and three-point 
approximations have the best accuracy (the relative errors axe almost zero everywhere). TANA- 
2 also has very good accuracy, in which the absolute values of relative errors are smaller than 
7% everywhere. The errors of TANA-1 and TANA are smaller than 20% everywhere. TANA-2, 
TANA-1 and TANA2 have lower errors (almost zero) when a s > 0 because the second point lies 
on the right side of the a s axis. For the other three cases, the second point X x does not lie in the 
same direction as D. When design variables x x and x 3 are changed along an opposite direction 
of x 2 and x 4 (case 2), TANA2 has the smallest errors when a s > 0, while TANA has the best 
accuracy when a s < 0. TANA1 also works well and has the same results where the errors are 
smaller than 9% everywhere. The two-point and three-point Hermite approximations are better 
than the linear and reciprocal approximations, but they are not as good as TANA-2, TANA-1 
and TANA. When the design variables are changed only along x x and x 3 (case 3), TANA2 has 
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very small errors (smaller than 4%), and TANA1 has almost the same accuracy as TANA2. The 
two-point and three-point Hermite approximations are good when a s > 0. When the design 
variables are changed only along x 2 and x 4 (case 4), TANA2 and TANA1 are accurate when 
a, > 0, and TANA has the lowest errors when a s < 0. The two-point and three-point Hermite 
approximations are good when a s > 0, but they don’t provide much improvement compared 
with the linear and reciprocal approximations. For all four cases, the relative errors of linear 
and reciprocal approximations are large. TANA has a single nonlinearity index r which is equal 
to -2.7. The nonlinearity indices for TANAl ,p,-, are -2.7625, -1.5,-2.825,-2.4875 for Xi , £2, £3, 
and £4 and e \ is -0.0862. The nonlinearity indices for £1, £2, £3 and £4 in TANA2 method are 
-2.7375, -1.45, -2.825 and -2.475, respectively, and £2 is 0.5527. The nonlinearity indices r for 
the two-point and three-point Hermite approximations are -2.469, -1.436, respectively. 

Example 2.2 

The three-bar truss example shown in Figure 2.2 is taken from Ref. [11]. The truss is 
designed subject to stress and displacement constraints with cross-sectional areas A a, Ab , and 
Ac ( Aa = Ac) as design variables. The approximations of a member C stress constraint are 
examined. The stress constraint using normalized variables is written as 

\/3 2 

d { X ) 1 + ^ X2 _|_ o.25£i 

<7(AT) is expanded at the point Xo(l. 0,1.0) for gi, g r , TANA, TANA-1 and TANA-2 
approximations. The nonlinearity index r, for two-point, three-point and four-point Hermite 
approximations with adaptive intervening variables, is determined by matching the function 
value at this point. The point Xi(1.5, 1.5) is the second point for TANA, TANA-1 and TANA- 
2 to calculate the nonlinearity index rj and p,. The two- point, three-point and four-point 
approximations are constructed based on selected data points which are similar to the points 
generated during the optimization process. The results comparison is shown in Table 2.1, which 
shows that the Hermite approximations have smaller errors, and TANA, TANA-1 and TANA- 
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Fig. 2.1a Example 2.1 (Case 1) 



Fig. 2.1b Example 2.1 (Case 2) 
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Ft*. 2.1c Example 2.1 (Case 3) 



alpha 


Fig. 2.1d Example 2.1 (Case 4) 
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Fig. 2.2 Three— bar Truss 


2 have the same accuracy as the reciprocal approximation because the nonlinearity index is 
equal to -1. Comparing the results of two types of intervening variables, the results of type II 
intervening variables are again better than those of type I for most of the points. 


Example 2.3 

This example has an implicit constraint function requiring a finite element analysis. The 
frame structure shown in Fig. 2.3 is modelled with 313 beam elements with I-sections. The 
cross-sectional areas of all members are selected as the design variables. The vertical loads at 
nodes 15, 16, 88, 89 are -26, -30,-18,-20 kips, respectively; the horizontal loads at nodes 6, 11, 
17 through 65 by 3, 68 through 82 by 7, and 90 through 175 by 5 are 4 kips ; and the horizontal 
load at node 1 is 2 kips. The approximation to the vertical displacement d at the tip point 
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Fin 2.3 313 member frame 
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Fig. 2.4a 313 Member FVame (Case 1) 



Fig. 2.4b 313 Member FVame (Case 2) 
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(node 16) is examined, which is an implicit function of 313 design variables and is written as 

g(X) = d/d lt m ~ 1 

where d[ im is the displacement limit of 4.0 in. Young’s modulus is 2.9 x 10 7 psi, and the 
Possion’s ratio is 0.3. The initial cross-sectional areas Xo are 30.59 in 2 , and the normalized 
design variables are defined as 



All of the approximations except TANA1 and Hermite are expanded at the point .X^l, 1 , — , 1)- 
The previous point is selected as Xi(1.25, 1.25,... ,1.25) for case 1 and -Xi(l. 2, 0.8,1. 2, 0.8,. ..,1.2) 
for case 2. TANA1 is expanded at X x and matched at X 2 for two cases. The absolute errors 
of all the approximations are calculated using Eq. (2.6.1b) to avoid the numerical problems 
in computing the relative errors when the exact g(X ) values are close to zero. The results 
comparison of several methods is shown in Figs. 2.4a and 2.4b. Fig. 2.4a shows that when the 
design variables are changed along the same direction, the errors of TANA TANA-2 and two- 
point Hermite are almost zero. TANA-1 has good accuracy when a s is greater than zero. Fig. 
2.4b shows that when the design variables are changed along D = {—1, 1 , —1, 1,... — 1} T (case 2), 
TANA and two-point Hermite have the lowest errors, and TANA1 and TANA2 also have good 
accuracy; they are much better than the linear and reciprocal methods. The results indicate 
that the proposed approximations have very good accuracy even for large scale problems with 
hundreds of design variables. 

2.7 Summary of Approximations 

Multi-point function approximations are developed for the mathematical optimization and 
probability analysis of structures. In the two-point approximations (TANA, TANA-1 and 
TANA-2), two-point information is used to construct the approximations. In particular, TANA- 
1 and TANA-2 approximations use both function values and gradients at two points to construct 
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the approximations. The intervening variables with adaptive nonlinearity index/indices are 
used to make the approximations closer to the actual nonlinear functions. TANA reproduces 
exact function values at two points and exact gradients at the current point. TANA-1 
reproduces exact gradients at two points and exact function values at the current point. TANA- 
2 reproduces exact function values and gradients at both points. The Hermite interpolation 
concept available for a single variable is extended to multidimensional problems by retaining 
the property of the same function and gradient values at the known data points. Two types 
of intervening variables are used along with the Hermite approximation for demonstrating the 
advantages of having adaptive intervening design variables. These intervening variables attempt 
to make the approximations closer to the actual nonlinear functions. 

In the first example with high nonlinearity, 2-point and 3-point Hermite approximations 
produce the best results as design variables are changed along the same direction for case 1. 
However, in the other three cases, 2-point and 3-point Hermite approximations are not better 
than TANA, TANA-1 and TANA-2. The Hermite approximations, particularly for 3-point 
approximations, slightly oscillate around the known points so that some local points of the 
approximations are generated. In the last two structural examples, TANA-2 and the Hermite 
approximations produce very good results. 

The computational results indicate that the Hermite approximation can provide very 
accurate results when the test points are closer to the known data points or when they 
interpolate. However, for some cases, it may result in an approximation with multiple local 
points. TANA1, TANA2 and TANA can provide better accuracy than the linear and reciprocal 
methods for highly nonlinear problems where the functional dependency on design variables is 
difficult to predict. TANA2 is better than TANA and TANA1 for most cases. For some cases, 
TANA-2 could be slightly less accurate than the Hermite approximation, but it is much more 
stable than the Hermite approximation. The accuracy improvement of TANA1 compared to 
TANA2 is not clearly evident, and it is better than TANA for only a few cases. TANA works 
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very well for the complex problems (the last two examples) even with a single nonlinearity index. 
The TANA, TANA-1 and TANA-2 approximations perform extremely well in extrapolating a 
function. These adaptive two point approximations are highly effective for large scale structures. 
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CHAPTER 3. SAFETY INDEX AND MPP CALCULATIONS 


3.1 Limit State Function 

If a structure or part of a structure exceeding a specific limit is unable to perform a required 
performance, this specific limit is called a limit state. There are two kinds of limit states: one is 
the load-bearing capacity, and the other is the normal performance. The former mainly concerns 
the structural safety, and the latter concerns the structural applicability and durability. The 
structure will be considered unreliable if the failure probability of the structural limit state 
exceeds the required value. 

Assuming that the reliability of the structure depends upon n independent random variables, 
X = {xi,x 2 , ....,x n } T , the state function of the structural reliability is 

g(X) = g(x u x 2 ,...,x n ) (3.1.1) 

Let 

g(X) = g(x i,x 2 ,...,x n ) = 0 (3.1.2) 

Eq. (3.1.2) is the limit state function of the structural reliability, which separates the design 
space into ‘failure’ and ‘safe’ regions, i.e., 

g(X) > 0, x,- € Safe region (3.1.3a) 

g(X) = 0, Xj € Failure surface (3.1.36) 

g(X) < 0, Xi € Failure region (3.1.3c) 

The simplest example of the limit state function can be given as the following stress-strength 
problem: 

g(R,S) = R-S = 0 (3-1-4) 
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Fig- 3.X Limit State Surface between Failure and Safe Regions 

where R is the strength, S is the stress resultant, and g(R, S ) is the limit state function of the 
structural reliability. Fig. 3.1 shows that the limit state of the line, R=S, separates the design 
space into two regions: one is the safe region of S < R, and the other is the failure region of 
S> R. 

For most of structures, the limit states can be divided into three categories: 

1. Ultimate limit states are related to a structural collapse of part or all of the structure. 
Examples of the most common ultimate limit states are corrosion, fatigue, deterioration, fire, 
plastic mechanism, progressive collapse, fracture, etc. Such a limit state should have a very 
low probability of occurrence, since it may lead to loss of life and major financial losses. 

2. Damage limit states axe related to the damage of the structure. Examples of damage limit 
states are excessive or premature cracking, deformation or permanent inelastic deformation, etc. 
Such a limit state is often included in the above category. 

3. Serviceability limit states are related to disruption of the normal use of the structures. 
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Examples of serviceability limit states are excessive deflection, excessive vibration, drainage, 
leakage, local damage, etc. Since there is less danger than in the case of the ultimate limit 
states, a higher probability of occurrence may be tolerated in such limit states. 

3.2 Reliability Index / Safety Index 

For simplicity, the limit state function given in Eq. (3.1.4) is taken as an example again. 
The probability of failure is computed as 

Pf= [ S)dRdS (3.2.1) 

Jo 

where /rs(-) is the joint probability density function of R and S. Q is the failure region modeled 
by the limit state function, g(X) < 0, as shown in Fig. 3.1. 

Assuming that the strength (R) and stress (S) are random variables normally distributed, 
the limit state function g(R, S ) is normally distributed. According to Eqs. (B.4) and (B.6) 
given in Appendix B, the mean value and standard deviation of the function g(R , S ) are given 
as 


g g = gR- gs (3.2.2) 


a g — yJvR + Vs (3.2.3) 

where gR and gs are the means of R and S', respectively, and ctr and as are the standard 
deviations of R and 5, respectively. The probability density function of g{R,S) is 

m = < 3 - 2 - 4 > 

a g \/ 2n 2. a g 

The failure probability is 

Pf = f fg(9)d9 (3.2.5) 

J — oo 
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Fig, 3.2 Geometrical Illustration of the Cornell Reliability Index, p c , (I) 


and the reliability or probability is 

P = 1 - P, = r f,(g)dg 

JO 

By introducing the standard normalized variable u with . 


when g = 0, the lower limit of u is given as 



( 3 . 2 . 6 ) 


( 3 . 2 . 7 ) 


( 3 . 2 . 8 ) 
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and when g = +oc, the upper limit of u tends to be +oo. When using integral transformation 
by considering Eqs. (3.2.4) and (3.2.7), as well as the lower and upper limits of u, Eq. (3.2.6) 
becomes 


- L 


OO J 1 

. — exp( — -u)du 
U L 2 ' 

Hr — Ps 


= i - *( n — 

\J Or + O 
= 1 -*(-/?) 

= m 


) 


(3.2.9) 


where $(.) is the standard normal cumulative distribution function. (3 is defined as the 
reliability index or safety index for uncorrelated (independent) variables: 


a _ _ PR- Ps 


(3.2.10) 


a 9 \J Or + 0% 

(3 is the reciprocal of the estimate of coefficient of variance in g(R,S). If the difference 
between the means of the strength and the stress is reduced, decreases and then Pj increases. 
Otherwise, if either a R or cr s or both are increased, (3 will become smaller and hence Pj will 
increase. Therefore, f3 is a direct measure of the reliability of the structure, and a larger (3 
represents greater reliability or lower probability of failure. 

The safety index given in Eq. (3.2.10) is also called the Cornell reliability index, f3 c , [1]. 
The geometrical illustration of the Cornell reliability index is shown in Fig. 3.2. In this one- 
dimensional case, the failure surface is simply a point g = 0. The idea behind the reliability 
index definition is that the distance from location measure g g to the limit state surface provides a 
good measure of reliability. The distance is measured in units of the uncertainty scale parameter 
a g . Fig. 3.3 gives further geometrical illustration of the safety index, which shows that the 
shaded area to the left of the origin is the probability of failure. 

The above one-dimensional geometrical definition of the safety index is often used for 
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Fig. 3.3 Geometrical Illustration of the Cornell Reliability Index, (3., (II) 


describing the Cornell reliability index. A more general definition of the safety index can 
be given as follows. Introduce standard normalized random variables of R and 5, 

R=^S., S = ^ (3.2.11) 

or o s 

where [ir and [is are the mean values of random variables R and S, respectively; and 
ctr and os are the standard deviations of R and S', respectively. The limit state surface 
g(R , S) = R — S = 0 in the (R,S) coordinate system can be transformed into a straight line in 
the standard normalized (R, S) coordinate system by substituting Eq.(3.2.11) 

g(R, S) = Ror - So s + {[ir - [is) = 0 (3.2.12) 
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Fig. 3.4 Geometrical Illustration of Safety Index, p , (III) 


The shortest distance from the origin in the ( R , S) coordinate system to the failure surface 
g(R , S) = 0 is equal to 

QP » - ( 3 . 2 . 13 ) 

By comparing Eq. (3.2.10) with this equation, it is obvious that the shortest distance OP is 
the safety index ft, i.e., 
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(3.2.14) 


/? = OP* = 4 ?=* 

\Afi + °S 

The geometrical illustration of the safety index is given in Fig. 3.4. Therefore, a general 
geometric definition of the safety index /3 is the shortest distance from the origin to the limit 
state surface. This definition can be used for not only the Cornell reliability index, but also 
general cases, such as the following Hasofer-Lind reliability index. It is necessary to point 
out that even though the definition of the safety index can be used for general cases, but Eq. 
(3.2.14) can only be applied for the problem having the limit state function given in Eq. (3.1.4) 
and the normally distributed random variables R and S. For the nonlinear limit state function 
and non-normal distribution variables, the safety index calculations will be given later. 

3.3 First-Order Second-Moment (FOSM) Method 

In the above sections, the limit state function was considered simply linear and to contain 
just two normally distributed variables. However, in practice, the limit state function can 
be nonlinear, the size of the random variables X can be very large, and their distributions 
can be of other types such as lognormal, Weibull, extreme value, etc. It is necessary that all 
uncertainties must be contained in the joint probability density function fx{X) in calculating 
the failure probability and the limit state functions. In fact, it is usually extremely difficult or 
even impossible to construct the joint density function and/or determine each of the individual 
density functions because of the scarcity of statistical data. Even in the case where statistical 
information may be sufficient to determine these functions, it is often impractical to perform 
numerically the multidimensional integration over the failure region 0 by using numerical 
integration or Monte Carlo simulation due to the complexity, nonlinearity and time-consuming 
analyses of the limit state functions. 

The first-order second-moment (FOSM) method simplifies the functional relationship and 
alleviates the above difficulties. The name first-order comes from the first-order expansion of 
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the function. In principle, the random variables are characterized by their mean values (first 
moments) and standard deviations (second moments). This is possible for any continuous 
mathematical form of the limit state equation. The different ways of simplifying the limit 
state function form different reliability analysis algorithms. As implied, inputs and outputs are 
expressed as the mean and standard deviation. Higher moments, which might describe skew 
and flatness of the distribution, are ignored. 

3.3.1 Mean Value Method 

In the mean value method, the limit state function is linearized by means of the Taylor 
series expansion (truncated at the linear terms only) at the mean value point. Assuming that 
the X variables are statistically independent, the first-order Taylor series expansion of the limit 
state function at the mean g = {g Xl , g X2 , g Xn } T ' s 

g(X) « g(g) + (X - g)g' (g) (3.3.1) 

The mean value of the approximate limit state function g(X) is 


H- g » E[g(g)\ 

= M 

= g(n Xi ,Hx 2 ,-,fix n) (3.3.2) 

The variance of the approximate limit state function g{X) is 

Var[g{X )] * Var[g(g)} + Var[(X - g)g'(g)} (3.3.3) 

Because 

Var[g(fi)] = 0, Var[g'(g)\ = 0 (3.3.4) 


Var[(X - g)g\fi)\ - V ar[X g' (g)} - gV ar[g' (g)} 
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= Var[Xg'(n )] 

= W(n)] 2 Va r {X) 


(3.3.5) 


Therefore, the standard deviation of the approximate limit state function is 


= v /[ S '(/<)] 2 Var(A:) 

= KE#lx=,)H] I/! (3-3.6) 

t = l UXt 

The reliability index /? is computed as: 

p=^- (3.3.7) 

U 9 

Eq. (3.3.7) is the same as Eq. (3.2.10) if the limit state function is linear. If the limit 
state function is nonlinear, the approximate limit state surface is obtained by linearizing the 
original limit state function at the mean value point. Therefore, this method is called the mean 
value method, and the given in Eq. (3.3.7) is called a mean value first-order second-moment 
(MVFOSM) reliability index. 

In the general case with the independent variables of n-dimensional space, the failure surface 
is a hyperplane and can be defined as a linear failure function: 

g(X) = co + i£ciXi ( 3 - 3 - 8 ) 

i=i 

The reliability index given in Eq. (3.3.7) can still be used for this n-dimensional case, in which 


fig = Cq + Ci (l Xl + C 2 Hx 2 + — + CnH Xn 


(3.3.9) 


<75 = 




(3.3.10) 
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Example 3.1 


The performance function is 

g(x i, x 2 ) = £j -fi Xj — 18 

in which xj and X 2 are the random variables with normal distributions (mean fi Xl = \i X2 = 10.0, 
standard deviation < 7 Xl — cr l2 = 5.0). The mean value method is used to solve the safety index 

ft- 

The mean of the linearized performance function is 

fj-g = 0(ftn>P*2) = 1982.00 

The standard deviation of the linearized performance function is 


- tA 


dxi 


^i) 2 + ( 


9g(j^x 1 ? ) 

dx 2 4 


/ X2; 


= ^(3 x 10 2 x 5.0) 2 + (3 x 10 2 x 5.0) 2 
= 2121.32 


From Eq. (3.3.7), the safety index ft is 


^imoo 

M - 2121.32 




The mean value method changes the original complex probability problem into a simple 
one. This method directly establishes the relationship between the reliability index and the 
basic parameters (means and standard deviations) of the random variables. However, there are 


two serious drawbacks in the mean- value FOSM method: 

1. Evaluation of reliability by linearizing the limit state function about the mean values 
leads to erroneous estimates for performance functions with high nonlinearity, or for large 
coefficients of variation. This can be seen from the following mean value calculation of g(X), 
assuming that the truncation of the Taylor series expansion after the first three terms is, 
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g(X) « g(n) + (X - fi)g'(n) + — ^ g"(fi) (3.3.11) 

Based on Eq. (B.4), the mean value of the approximate limit state function g(X) can be 
calculated as 

n * EW)] + E[(X - ( 3 . 3 . 12 ) 

Because 

E\g{fi)] = g(ft) (3.3.13) 

E[{X - fi)g'(fi)] = E[Xg'(fi)} - E[ng'(fi)] 

= 9\v)E{X) - fig’in) 

= 0 (3.3.14) 

E^^-9"M) = - K) 2 ) 

= l -g"( h )Var(X) (3.3.15) 

From Eq. (3.3.15), it is obvious that the second term of Eq. (3.3.11) depends on the variance 
of X and the second-order gradients of the limit state function. If the variance of X is small or 

the limit state function is close to linear, the second term of Eq. (3.3.11) can be ignored and 

the mean value of g{X) is the same as Eq. (3.3.2). Otherwise, large errors in the mean value 
estimation will result. 

2. The mean- value FOSM method fails to be invariant with different mechanically equivalent 
formulations of the same problem. This is a problem not only for nonlinear forms of <?(.), but 
also for certain linear forms. Example 3.2 shows that two different equivalent formulations of 
the limit state function for the same problem results in different safety indices. 
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Fig. 3.5 Simply Supported Beam Loaded at the Midpoint 

Example 3.2 

This example is taken from Ref. [2], Figure 3.5 shows a simply supported beam loaded 
at the midpoint by a concentrated force P. The length of the beam is L, and the bending 
moment capacity at any point along the beam is WT, where W is the plastic section modulus 
and T is the yield stress. All four random variables P , L , W , and T are assumed to be 
normal distributions. The mean values of P, P, W, and T are 10 kN , 8m, 100 x 10 -6 m 3 , and 
600 x 10 3 kN/m 2 , respectively. The standard deviations of P, L, W, and T are 2kN, 0.1m, 
2 x 10 -5 m 3 , and 10 5 kN/m 2 , respectively. Two different equivalent formulations of the limit 
state function can be given as 


9l (P,L,W,T) = WT~ — 
g 2 (P,L,W,T) = T 


The safety index for the g x function is 


100 x 10 -6 X 600 X 10 3 - ^ 

4 


fix 


Vsi 


'91 


\J{—2 x 2) 2 + (-2.5 x 0.1) 2 + (600 x 10 3 x 2 x lO" 5 ) 2 + (100 x 10" 6 x 10 5 ) 2 
= 2.48 


and the safety index for the <72 function is 


ft = — 

a 92 


600 x 10 3 - -S 


4X100X10- 6 


y/(- 2 x 10 4 X 2) 2 + (-0.25 x 10 2 ) 2 + (4 x 10 4 ) 2 + (1. x 10 5 ) 2 
= 3.48 


/?! and /?2 are different even though the above two limit state equations are equivalent. 
3.3.2 Advanced First-Order Second-Moment Method - Hasofer and Lind Safety Index 

In the previous sections, Figs. 3.2-3. 4 showed how the reliability index could be interpreted 
as the measure of the distance to the failure surface. In the one-dimensional case, the standard 
deviation of the safety margin was conveniently used as the scale. To obtain a similar scale in 
the case of more basic variables, Hasofer and Lind (1974) proposed a nonhomogeneous linear 
mapping of the set of basic variables into a set of normalized and independent variables u,-. Take 
the example of the stress-strength given in Section 3.1. Consider the fundamental case with the 
independent variables of strength, R, and stress, S', which are both normally distributed. First, 
Hasofer and Lind introduced the standard normalized random variables given in Eq. (3.2.11), 
and transformed the limit state surface g(R, S) = R — S = 0 in the original (R, S ) coordinate 
system into the limit state surface given in Eq. (3.2.12) in the standard normalized ( R , S ) 
coordinate system. Here, the shortest distance from the origin to the linear failure surface is 
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defined as the safety index /?. The point P*(R*, S *) on g{R,S) = 0, which corresponds to this 
shortest distance, is referred to as the checking point or design point. 

X-space U-space 



Fig. 3.6 Mapping of Failure Surface from X-space to U-space 

In a general case with normally distributed and independent variables of n-dimensional 
space, the failure surface is a nonlinear function: 


g(X) = g(xi,X 2 , ...,x n ) 


(3.3.16) 
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Transform all the variables into their standardized forms: 


fixi 

Ui = 

o- Xi 

where fi Xi and a Xt represent the mean value and standard deviation of x,. respectively. The 
mean value and standard deviation of the standard normally distributed variable, u,-, are zero 
and unity, respectively. Any orthogonal transformation of the standard normally distributed 
variables, U = {u x , tt 2 > •••, n n } T , results in a new set of normalized and uncorrelated variables. 
Therefore, the distributions of U are rotationally symmetric with respect to the second-moment 
distribution. Based on the transformation of Eq. (3.3.17), the mean value point in the 
original space (X-space) is mapped into the origin of the standard normal space (U-space). 
The failure surface g(X) = 0 in X-space is mapped into the corresponding failure surface 
g(U ) = 0 in U-space as shown in Fig. 3.6. Due to the rotational symmetry of the second- 
moment representation of U, the geometrical distance from the origin in U-space to any point 
on g(U ) = 0 is simply the number of standard deviations from the mean value point in X- 
space to the corresponding point on g(X) = 0. The distance to the failure surface can then be 
measured by the safety index function 


(3.3.17) 


0(U) = ( U T U ) V 2 , U € g(U) = 0 (3.3.18) 

The safety index j3 is the shortest distance from the origin to the failure surface g(U) = 0, i.e. 

/?= min (U T U) l/2 (3.3.19) 

ue 9 (U)= o v ' y ’ 

This safety index is also called the Hasofer and Lind safety index, @hl- The point 

U*(ul, uj, •••) u*) on g(U) = 0 is a design point. The values of the safety indices given in 

Eqs. (3.3.7) and (3.3.19) are the same when the failure surface is a hyperplane. 

The Hasofer and Lind reliability index can also be interpreted as a first-order second-moment 

reliability index. The value of (3hl is the same for the true failure surface as for the approximate 
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tangent hyperplane at the design. The ambiguity in the value of the first-order reliability 
index is thus resolved when the design point is taken as the linearization point. The resultant 
reliability index is a sensible measure for the distance to the failure surface. 

3.3.2. 1 Safety Index Model - Optimization Problem 

Eq. (3.3.19) shows that the safety index ft is the solution of a constrained optimization 
problem in the standard normal space: 

Minimize : ft{U) = {U T UY^ 2 (3.3.20a) 

Subject to : 9{U) = 0 (3.3.206) 

There are many algorithms available that can solve this problem, such as mathematical 
optimization schemes or other iteration algorithms. In Ref. [3], several constrained optimization 
methods were used to solve this optimization problem, which included primal (feasible 
directions, gradient, projection, reduced gradient), penalty, dual and Lagrange methods. Each 
method has its advantages and disadvantages, depending upon the attributes of the method 
and the nature of the problem. Unlike the optimization schemes, another class of method is 
the iteration algorithm. In the following section, the most commonly-used iteration algorithms, 
the HL and HL-RF methods, are introduced to solve the reliability problems. 

3.3.2.2 Solve Safety Index Model Using HL Iteration Method [4] 

The HL method was proposed by Hasofer and Lind, and the HL-RF method was extended 
by Rackwitz and Fiessler based on the HL method to include random variable distribution 
information. The HL method is introduced in the following section and the HL-RF method 
will be given later. Assume that the limit state surface with n-dimensional normally distributed 
and independent random variables X is 

g(X) = g{x u x 2 ,...,x„) = 0 (3.3.21) 
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This limit state function can be linear or nonlinear. Based on the transformation given in 
Eq. (3.3.17), the limit state function given in Eq. (3.3.21) is transferred into 

g{U) = g{<T Xl u-i + fx Xl , a X 2 u 2 4- p X2 , ...,cr Xn u n + = 0 (3.3.22) 

The normal vector from the origin O to the limit state surface g(U) generates an intersection 
point P*, and this point has been defined as the design point before. The distance from the 
origin to the design point is the safety index 0. The first-order Taylor series expansion of g{U) 
at the design point U * = ...,u*} T is 

g(U) a g(U-) + £ ^E2( Uj - <) (3.3.23) 

«=1 dU i 

From the transformation of Eq. (3.3.17), we have 


dgjU) _ dg{X) 
du{ dxi 


(3.3.24) 


The shortest distance from the origin to the above approximate failure surface given in Eq. 


(3.3.23) is 


OP’ = $ = 


s(V ‘ ) - £ 


t=X 



The direction cosine of the unit outward normal vector is given as 


(3.3.25) 


cosO x t = cosd U) 


?g(un 

duj 




»«<*•> 

dxj 



dxi 


<? Xi 


)2]l/2 


CL, 


(3.3.26) 


where a, expresses the relative effect of the corresponding random variable on the total 
variation. Thus, it is called the sensitivity factor. More details about a, will be given later. 
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The coordinates of the point P * are computed as 



= 0P*cos9 Xi 
= /3cos9 Xi 


The coordinates corresponding to P * in the original space are 

x* = fi Xl + /3(T Xi cos9 Xi , {i = l,2,...,n) 
Since P* is a point on the limit state surface, so 


(3.3.27) 


(3.3.28) 


g{x\,x* 2 , ...,<) = 0 


(3.3.29) 


The main steps of the HL iteration method consist of: 

1) Define the appropriate limit state function of Eq. (3.3.21); 

2) Set the mean value point as an initial design point, i.e., x* = fi Xi , i = 1,2, ...,n, and 

compute the gradients V^(X*) = {^p, of the limit state function at this 

point; 

3) Compute the initial /? using the mean value method (Cornell safety index), i.e, (3 = ~f 
and its direction cosine; 

4) Compute a new design point X * from Eq. (3.3.28), and function value and gradients at 
this new design point; 

5) Compute the safety index /? using Eq. (3.3.25) and the direction cosine or sensitivity 
factor from Eq. (3.3.26); 

6) Repeat the steps (4) -(6) until the estimate of /3 converges; 

7) Compute the coordinates of the design point or most probable failure point (MPP), X*. 
In some cases, the failure surface may contain several points corresponding to stationary 

values of the reliability index function. Therefore, it is necessary to use several starting points 
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to find all stationary values 0i, 02, 0m- This is called a multiple MPP problem. More details 

about the multiple MPP problem will be given later. The Hasofer and Lind safety index is 

0hl = min{0 i, # 2 , -,0m} (3.3.30) 

In Eqs.(3.3.7) and (3.3.25), the difference between the mean value method and HL method 
is that the HL method approximates the limit state function using the first-order Taylor 
expansion at the design point X * or U* instead of the mean value point g. Also, the mean value 
method doesn’t require iterations, while the HL method needs several iterations to converge for 
nonlinear problems. Therefore, the HL method usually provides better results than the mean 
value method for the nonlinear problems. How well a linearized limit state function g(U ) = 0 
approximates a nonlinear function g(U) in terms of the failure probability Pj depends on the 
shape of g(U ) = 0. If it is concave towards the origin, Pf is underestimated by the hyperplane 
approximation. Similarly, a convex function implies overestimation. However, there is no 
guarantee that the HL algorithm converges in all situations. Furthermore, the Hasofer and 
Lind method only considers normally distributed random variables, so it can not be used for 
the nonnormal distributed random variables. Instead, another similar iteration method, called 
the RF method, which will be introduced later, needs to be used. 

Note: The HL method described here is a little different from the one given in Ref. [2]. In 
Ref. [2], the coordinates of the design point X* are determined first, and the safety index 0 
is calculated by using Eq. (3.3.25). The iteration process stops when the estimation of x* is 
stable. 

Example 3.3a 

In this example, the performance function, mean values, standard deviations, and 
distributions of both random variables are the same as in Example 3.1. The HL method is 
used to solve the safety index 0. 
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(1) Iteration 1: 

(a) Set the mean value point as an initial design point and required /? convergence tolerance 
as e T = 0.001. Compute the limit state function value and gradients at the mean value point 


g(X*) = g((i Xl ,n X2 ) - n 3 Xl + /4 2 - 18 
= 10.0 3 + 10.0 3 - 18 
= 1982.00 

= 3/4 = 3 x 10 2 = 300 
P~l = 3// 2 2 = 3 x 10 2 = 300 

dx 2 

(b) Compute the initial /3 using the mean value method and its direction cosine ai 


fii 


f^g 


°9 


g(x-) 




dx x 


) 2 + ( 


dx 2 


'*2) 


1982.00 

(300 x 5.0) 2 + (300 x 5.0) 2 
0.9343 


<*1 






X\ 


dg(nxi _ 

ri 


> 2 +( 


dgjvxi ,?x 7 ) 
dx 2 


' *2 > 


300 x 5.0 


y/(300 x 5.0) 2 + (300 x 5.0) 2 
-0.7071 
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a 2 = 


dj^\i* a X2 

( 8 » ( y l I < 7 ,, )* + ( > a, 

300 x 5.0 

^(300 x 5.0) 2 + (300 x 5.0) 2 
-0.7071 


(c) Compute a new design point X* from Eq. (3.3.28) 


Xj — fi x i “I" /5icr Zl Oi 

= 10.0 + 0.9343 x 5.0 x (-0.7071) 
= 6.6967 


X 2 /^X2 "f"~ ^1^X 2 ^2 

= 10.0 + 0.9343 x 5.0 x (-0.7071) 
= 6.6967 


«i = 


x\ - fi Xl 


'x\ 


U 2 = 


X 2 - lh 2 


' X2 


6.6967 - 10.0 
5.0 

6.6967 - 10.0 
5.0 


-0.6607 

-0.6607 


(2) Iteration 2: 

(a) Compute the limit state function value and its gradients at X* 


g(X*) = (xj) 3 + (x;) 3 - 18 = 6.6967 3 + 6.6967 3 - 18 = 582.63 
= 3 x (xT ) 2 = 3 x 6.6967 2 = 134.5374 

OX 1 
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%jL\x* = 3 x (x;) 2 = 3 X 6.6967 2 = 134.5374 

UX2 

(b) Compute /? using Eq. (3.3.25) and the direction cosine 


@2 — 


g(X-) - E 

1=1 


E 


1=1 


582.63 - 134.5374 x 5.0 x (-0.6607) - 134.5374 x 5.0 x 
= 1.5468 


(134.5347 x 5.0) 2 + (134.5347 x 5.0) 2 


Oil 


134.5374 x 5.0 

^/(134.5374 x 5.0) 2 + (134.5374 x 5.0) 2 
-0.7071 


&2 — a i — -0.7071 


(c) Compute a new design point X* 


Xj — j 4" @2&x\ 

= 10.0 + 1.5468 x 5.0 x (-0.7071) 
= 4.5313 


x; = x* = 4.5313 


u . _ ~ V * i _ 4.5313 - 10.0 _ _ x 0937 

1 5.0 


'Xl 


(-0.6607) 
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(d) Check 0 convergence 


«5 = u* = -1.0937 


IA-AI 
A 

Since e > e r , continue the process. 

(3) Iteration 3: 

a) Compute the limit state function 

0(X*) = (x?) 3 + (x;) 3 - 18 = 4.5313 3 + 4.5313 3 - 18 = 168.08 
P~\x- = 3 x (x*) 2 = 3 x 4.5313 2 = 61.598 

UX i 

^r-\x> = 3 x (x;) 2 = 3 x 4.5313 2 = 61.598 
dx 2 

(b) Compute 0 using Eq. (3.3.25) and the direction cosine a, 


1.5468 -0.9343 
0.9343 


= 0.6556 


value and its gradients at X* 


03 ~ 


am - i 

1=1 




t' = l 


168.08 - 61.598 x 5.0 x (-1.0937) - 61.59 8 x 5.0 x (-1.0937) 
= 1.9327 


^(61.598 x 5.0) 2 + (61.598 x 5.0) 2 


Ctl 


XW, u-o 2 +(S *-^) 2 

61.598 x 5.0 

(61.598 x 5.0) 2 + (61.598 x 5.0) 2 
-0.7071 
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a 2 = <*i = —0.7071 


(c) Compute a new design point X* 


Xj — fj-x i far^ai 

= 10.0 + 1.9327 x 5.0 x (-0.7071) 
= 3.1670 


= x\ = 3.1670 


u. 


- (i Xl _ 3.1670 - 10.0 = 
a Xl 5.0 

u\ = = -1.3666 


- -1.3666 


(d) Check /? convergence 


|<?3-fel _ 1-9327 - 1.54 68 _ n , JQ , 
0 2 1.5468 

Since e > e r , continue the process. 

(4) Iteration 4: 

a) Compute the limit state function value and its gradients at X* 


g(X*) = (xj) 3 + (x;) 3 - 18 = 3.1670 3 + 3.1670 3 - 18 = 45.529 

QL \ x . = 3 x (x^) 2 = 3 x 3.1670 2 = 30.0897 
dx\ 

J*L\ X . = 3 x (x;) 2 = 3 x 3.1670 2 = 30.0897 
dx 2 

(b) Compute f} using Eq. (3.3.25) and the direction cosine a; 
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45.529 - 30.0897 x 5.0 x (-1.3666) - 30.0897 x 5.0 x (-1.3666) 
(30.0897 x 5.0) 2 + (30.0897 x 5.0) 2 

= 2.1467 




30.0897 x 5.0 

(30.0897 x 5.0) 2 + (30.0897 x 5.0) 2 
-0.7071 


CC2 = cti = —0.7071 


(c) Compute a new design point X * 


Xj — fi x j “I" 

= 10.0 + 2.1467 X 5.0 x (-0.7071) 
= 2.4104 


x\ = x* = 2.4104 


u 


* 

1 


X* - ti Xl _ 2.4104 - 10.0 
a Xl 5.0 

u* 2 = tij = -1.5179 


-1.5179 
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(d) Check 0 convergence 


2.1467 - 1.9327 
£ ft 1.9327 

Since e > £ r , continue the process. 

(5) Iteration 5: 

a) Compute the limit state function value and its gradients at X* 

g (X *) = (x^) 3 + (a^) 3 - 18 = 2.4104 3 + 2.4104 3 - 18 = 10.01 
= 3 X (x*) 2 = 3 x 2.4104 2 = 17.43 

OX 1 

= 3 x (x^) 2 = 3 x 2.4104 2 = 17.43 
dx 2 

(b) Compute 0 using Eq. (3.3.25) and the direction cosine on 


& = 


»(*•) - e 

t=l 


1 = 1 


10.01 - 17.43 x 5.0 x (-1.5179 ) - 17.43 x 5.0 x (-1.5179) 
= 2.2279 


^(17.43 x 5.0) 2 + (17.43 x 5.0) 2 


a a = 




iA 


17.43 x 5.0 


^(17.43 x 5.0) 2 + (17.43 x 5.0) 2 




(x 2 — Q:i = — 0.7071 
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(c) Compute a new design point X 


— Mr i “t" fti^x\^\ 

= 10.0 + 2.2279 x 5.0 x (-0.7071) 
= 2.1233 


x\-x\ = 2.1233 


u 


* 

1 


x\ - Mn _ 2.1233 - 10.0 
<j x , 5.0 


-1.5753 


(d) Check ft convergence 


u* = ul = -1.5753 


( 6 ) 


\ft 1 - M= 2 A 279 -^467 =0036 
ft 4 2.1467 

Since £ > e r , continue the process. 

Iteration 6: 

(a) Compute the limit state function value and its gradients at X * 


g(X m ) = (x ^) 3 + (x ^) 3 - 18 = 2.1233 3 + 2.1233 3 - 18 = 1.1451 

p-\x‘ = 3 X (x :) 2 = 3 X 2.1451 2 = 13.8044 
dx\ 

p-\x» = 3 X (x ;) 2 = 3 x 2.1451 2 = 13.8044 

UX 2 

(b) Compute ft using Eq. (3.3.25) and the direction cosine a t 
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& — 


g(x-) - E 

t = l 





1.1451 - 13.8044 x 5.0 x (-1.5753) - 13.8044 x 5.0 x (-1.5753) 
= 2.2398 


^(13.8044 x 5.0) 2 + (13.8044 x 5.0) 2 




Oil — - 


X! 


\Afir U ,ff *i) 2 + (ft U*^) 2 

13.80 44 x 5.0 

^/(13.8044 x 5.0) 2 + (13.8044 x 5.0) 5 
-0.7071 


a2 = Oi\ = —0.7071 


(c) Compute a new design point X * 


Xj — “H fi$&x\Oil 

= 10.0 + 2.2398 x 5.0 x (-0.7071) 
= 2.0810 


x* = xl = 2.0810 


u i = 


Xj - fl Xt 


'Xl 


2.0810 - 10.0 
5.0 


-1.5838 


u ; = = -1.5838 
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(d) Check 0 convergence 


^-/3^ = 2.2398 - 2.227? 

0 5 2.2279 

Since e > e r , continue the process. 

(7) Iteration 7: 

a) Compute the limit state function value and its gradients at X* 

g(X m ) = (art) 3 + ( x* 2 f - 18 = 2.0810 3 + 2.0810 3 - 18 = 0.023 
■p-\x- = 3 x (x*) 2 = 3 x 2.0810 2 = 12.9917 

OX\ 

~-\x< = 3 X (X 2) 2 = 3 X 2.0810 2 = 12.9917 

UX2 

(b) Compute 0 using Eq. (3.3.25) and the direction cosine or, 


05 = 


»(*■) - 1 


t=l 




«=i 


0.023 - 12.9917 x 5.0 x (-1.5838) - 12.9917 x 5.0 x (-1.5838) 


= 2.2401 


^(12.9917 x 5.0) 2 + (12.9917 x 5.0) 2 


Ql = - 


h. 

c 1 


dxi \X' <J x 1 


\/(fe + d£l*-°v) 2 

12.9917 x 5.0 

^(12.9917 x 5.0) 2 + (12.9917 x 5.0) 2 
-0.7071 


o 2 = o^i = —0.7071 
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(c) Compute a new design point X* 


x-^ — “I - 

= 10.0 + 2.2401 x 5.0 x (-0.7071) 
= 2.0801 


x* 2 = x\ = 2.0801 



Ift-W = 2.2401 -2.2398 = 

0 e 2.22398 

Since e < e T , stop the process. 

The safety index 0 is 2.2401. Since the limit state function value at the MPP X* is close to 
zero, this safety index can be considered as the shortest distance from the origin to the limit 
state surface. Compared to the safety index 0 = 0.9343 obtained from the Mean Value method 
given in Example 3.1, the safety index computed from the HL method is much more accurate 
for this highly nonlinear problem. 

Example 3.3b 

In this example, the performance function, the mean value of x u the standard deviations, 
and the distributions of both random variables are the same as in Example 3.1. The only 
difference between Examples 3.3a and 3.3b is that the mean value of x 2 is 9.9 instead of 10.0. 
The HL method is used to solve the safety index 0. 
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(1) Iteration 1: 

(a) Set the mean value point as an initial design point and required 0 convergence tolerance 
as s r — 0.001. Compute the limit state function value and gradients at the mean value point 


g(X*) = g(n Xl ,fi X2 ) = / 4 , + /4 “ 18 
= 10.0 3 + 9.9 3 - 18 
= 1952.299 

J^Im = 3/4 = 3 x 10 2 = 300 
= 3/i 2 = 3 x 9.9 2 = 294.03 

Ox 2 

(b) Compute the initial 0 using the mean value method and its direction cosine cv, 


0i 




g(X') 


dxj * 


'Xi 


) 2 + ( 


dx 2 


x 2 / 


1952.299 

^(300 x 5.0) 2 + (294.03 x 5.0) 2 
0.9295 






,Mx 2 ) \2 I ( MtE±ltE2l n- 12 

dx x °*l/ ' V 3 *, °x 2 ) 


6 x 2 


300 x 5.0 


^(300 x 5.0) 2 + (294.03 x 5.0) 2 
-0.7142 
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OC 2 


J>S-\ a 
3x 2 lAt 12 


.Mu ) _ \2 I / ^gUji.^2) - \2 

3xi ' V 3x2 X2 ' 

294.03 x 5.0 

^/(300 x 5.0) 2 + (294.03 x 5.0) 2 
= -0.7000 


c) Compute a new design point X * from Eq. (3.3.28) 


x\ = Pn + fi\cr Xl ai\ 

= 10.0 + 0.9295 x 5.0 x (-0.7142) 
= 6.6808 


%2 — Mx 2 4” 

= 9.9 + 0.9295 x 5.0 x (-0.7000) 
= 6.6468 


Ul = 


xi - p Xl 


'Xl 


u 2 = 


X 2 - p X2 


/ X 2 


6.6808 - 10.0 
5.0 

6.6468 - 9.9 
5.0 


-0.6638 

-0.6506 


(2) Iteration 2: 

(a) Compute the limit state function value and its gradients at X* 


g (X*) = (x^) 3 + (x^) 3 - 18 = 6.6808 3 + 6.6468 3 - 18 = 573.8398 
^L\ x . = 3 x (xj) 2 = 3 x 6.6808 2 = 133.8982 

oxi 
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S^-\x> = 3 X (xX) 2 = 3 x 6.6468 2 = 132.5409 
dx 2 


(b) Compute ft using Eq. (3.3.25) and the direction cosine a; 


ft2 = 


s(x-) - g 




t = l 


dx{ 


573.8398 - 133.8982 x 5.0 x (-0.6638) - 132.5409 x 5.0 x (-0.6506) 


= 1.5387 


7(133.8982 x 5.0) 2 + (132.5409 x 5.0) 2 


au 




\/(|^ 1**^1 ) 2 + d ^ l *** 7 ^) 2 

133.8982 x 5.0 

7(133.8982 x 5.0) 2 + (132.5409 x 5.0) 2 
-0.7107 


a 2 = - 




+ (|^U*^x 2 ) 2 

132.5409 x 5.0 

7(133.8982 x 5.0) 2 + (132.5409 x 5.0) 2 
-0.7035 


(c) Compute a new design point X* 


X 1 = 

= 10.0 + 1.5387 x 5.0 x (-0.7107) 
= 4.5323 
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3*2 M -^2 $ 2 & X 2*-*2 

= 9.9 + 1.5387 x 5.0 x (-0.7035) 
= 4.4877 


u i = 


/^ri 




U, = 


x 2 - \IX2 


'X2 


(d) Check j5 convergence 


4.5323 - 10.0 
5.0 

4.4877 - 9.9 
5.0 


-1.0935 

-1.0825 


Since e > £ r , 


£ = 

continue the 


I #2 ~ fill 

A 

process. 


1.5387 - 0.9295 
0.9295 


0.6554 


(21) Iteration 21: 

(a) Compute the limit state function value and its gradients at X * 


g (X m ) = K) 3 + K) 3 - 18 = 8.5253 3 + 4.2597 3 - 18 = 678.9088 

^L\ x . = 3 x (x?) 2 = 3 X 8.5253 2 = 218.0401 
dxi 

^-h.=3x (x^) 2 = 3 x 4.2597 2 = 54.4352 
dx 2 

(b) Compute /3 using Eq. (3.3.25) and the direction cosine or* 
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/?21 



678.9088 - 218.0401 x 5.0 x (-0.2949) - 54.4352 x 5.0 x (-1.1281) 
^(218.0401 x 5.0) 2 + (54.4352 x 5.0) 2 

= 1.1636 




218.0401 x 5.0 

^(218.0401 x 5.0) 2 + (54.4352 x 5.0) 2 
= -0.9702 


Ct2 ss: ■ 

v /(&^) 2 + d ^ U * o - X2 ) 2 
54.4352 x 5.0 

-^/ (218.0401 x 5.0) 2 + (54.4352 x 5.0) 2 
= -0.2422 

(c) Compute a new design point X* 


X x — 4 ” @2\<T Xl Ol\ 


= 10.0 + 1.1636 x 5.0 x (-0.9702) 
= 4.3553 


x\ = Mr 2 + finer X2 a 2 

= 9.9 + 1.1636 x 5.0 x (-0.2422) 
= 8.4908 


90 



u 1 


X* - fi Xl _ 4.3553 - 10.0 


' X\ 


5.0 


u, = 


x\ - n X2 _ 8.4908 - 9.9 _ 


* X2 


5.0 


-1.1289 

-0.2818 


(d) Check /? convergence 


jfa - ftoj = |1.1636- 1.1660[ = 0 002 
e 1.1660 

Since e > £ r , continue the process. 

(22) Iteration 22: 

(a) Compute the limit state function value and its gradients at X* 

g (X*) = (x^) 3 + (x^) 3 - 18 = 4.3553 s + 8.4908 3 - 18 = 676.7346 
= 3 x K) 2 = 3 X 4.3553 2 = 56.9049 

dxi 


dg_ 

dxi 


\ x . = 3 x (x;) 2 = 3 X 8.4908 2 = 216.2786 


(b) Compute (3 using Eq. (3.3.25) and the direction cosine a,- 


022 — 


/ Y*\ ^sjJLUrr 'll* 

9\X ) X' dxi a *i U i 

t=l 


2 

I 

t=l 




676.7346 - 56.9049 x 5.0 x (-1.1289) - 216.2786 x 5.0 x (-0.2818) 


^/(56.9049 x 5.0) 2 + (216.2786 x 5.0) 2 


= 1.1650 


<*i = - 




+ I*" 0-2:2 ) 2 

56.9049 x 5.0 


^(56.9049 x 5.0) 2 + (216.2786 x 5.0) 2 
-0.2544 
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a£l* ,<T *a 

a 2 = 7 = = = = = 

216.2786 x 5.0 

1^/(56.9049 x 5.0) 2 + (216.2786 x 5.0) 2 
= -0.9671 

(c) Compute a new design point X * 


— Hxi +/?2lC r ii<^l 

= 10.0 + 1.1650 x 5.0 x (-0.2544) 
= 8.5178 


x 2 = /** 2 + / 3 2 i < 7 l 2 a 2 


= 9.9 + 1.1650 x 5.0 x (-0.9671) 
= 4.2666 


. x\ - fi Xl 8.5178 - 10.0 

\<b -I ' "• ~ 

cr Xl 5.0 

Xo — fi X2 4.2666 — 9.9 

Uo = = — 


-0.2964 

-1.1267 


(d) Check /? convergence 


|/? 22 — 02 l \ 

&21 


1.1650 - 1.1636 
1.1636 


0.0012 


Since e > e r , continue the process. 
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(23) Iteration 23: 

(a) Compute the limit state function value and its gradients at X* 


g(x *) = (x*) 3 + (x*) 3 - 18 = 8.5178 3 + 4.2666 3 - 18 = 677.655 

^L\ x . = 3 x (xj) 2 = 3 x 8.5178 2 = 217.6582 
dx\ 

= 3 x (a :* 2 ) 2 = 3 x 4.2666 2 = 54.61056 
dx 2 

(b) Compute /? using Eq. (3.3.25) and the direction cosine a, 


g(X-) - £ 

1=1 


<Tx ,) 2 

677.655 - 217.6582 x 5.0 x (-0.2964) - 54.61056 x 5.0 x (-1.1267) 


^(217.6582 x 5.0) 2 + (54.61056 x 5.0) 2 

= 1.1657 



ax. 

217.6582 x 5.0 

^(217.6582 x 5.0) 2 + (54.61056 x 5.0) 2 
= -0.9699 


a 2 


8x2 


\x'V X2 



54.61056 x 5.0 


^(217.6582 x 5.0) 2 + (54.61056 x 5.0) 2 
-0.2434 


(c) Compute a new design point X * 


93 



Xj — fl x i "4" /^21^xi<-*l 

= 10.0 + 1.1657 x 5.0 X (-0.9699) 
= 4.3468 


Xj — fix 2 “I" /?21 0X2^2 

= 9.9 + 1.1657 x 5.0 x (-0.2434) 
= 8.4816 


u, = 


x x - fl Xl 


X\ 


U 0 = 


&2 f* x 2 


'XI 


(d) Check /? convergence 


4.3468 - 10.0 
5.0 

8.4816 - 9.9 
5.0 


-1.1306 

-0.2837 


I& 3 -& 2 I 1.1657- 1.1650 

e = = = 0.0006 

/9 22 1.1650 

Since e < e r , stop the process. 

The safety index converges after 23 iterations; however, the MPP is not on the limit state 
surface (</(X*) = 677.655). Also, from iterations 21, 22 and 23, the design point X * oscillates. 
If a convergence check for determining whether the MPP is on the surface or not is added, the 
process will continue. However, no fined MPP on the surface can be found after hundreds of 
iterations due to the oscillation. From this example, it is clear that the HL method may not 
converge in some cases due to its linear approximation. A more efficient method can be used to 
deal with this problem, and the correct safety index for this example is given in Example 3.8. 
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maximum PDF 



(a) Two-dimension 


(b) Three-dimension 


Fig. 3.7 Most Probable failure Point (MPP) 


3. 3.2.3 Most Probable failure Point (MPP) 

As mentioned in Section 3.3.2, the point £/*(«;, «5, ...,<) corresponding to the shortest 
distance from the origin to the failure surface g(U) = 0 is defined as the design point. Because 
of rotational symmetry and the Hasofer-Lind transformation, the design point in U-space 
represents the point of greatest probability density or maximum likelihood (Fig. 3.7). It 
makes the most significant contribution to the nominal failure probability Pj = $(-/?), so this 
design point is also called the most probable failure point (MPP). 

The MPP is important in structural analyses. For the problems having a single stationary 
point, as shown in Fig. 3.7, the MPP corresponds to the greatest probability density in the 
failure region and has the maximum failure probability. That is, it implies the most possible 
failure design in the structures due to the uncertainties. Searching the MPP on the limit state 
surface is a key step in the HL method. The improvement of the HL method compared with 
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the MVFOSM also comes from changing the expanding point from the mean value point to the 
MPP. 

3. 3. 2. 4 Sensitivity Factors 

As mentioned in section 3. 3. 2. 2, the direction cosine of the unit outward normal vector 
of the limit state function a,- given in Eq. (3.3.26) is defined as the sensitivity factor. The 
sensitivity calculation of the failure probability or the safety index to small changes in random 
variables usually gives useful information for studying the statistical variation of the response. 
The sensitivity factor shows the relative importance of each random variable to the structural 
failure probability. 

In Eq. (3.3.26), the physical meaning of Oj implies the relative contribution of each random 
variable to the failure probability (Fig. 3.8). For example, the larger the a, value is, the higher 
the contribution towards the failure probability due to 

oc\ oc 2 + ... + = 1 (3.3.31) 


In fact, ai is the sensitivity of the safety index ft at MPP. From the definition of ft as the 
distance from the origin to the limit state surface g{U ) = 0, it follows that 

dp d 


op o r~z ; r u t - 

fe = a^V“ I + “2+....,+<=- ? = a i 


i = 1, 2, ..., n 


(3.3.32) 


The sensitivity factors for the failure probability Pf are 


d_Pj_ 

dui 




(3.3.33) 


where represents the standard normal density function. 

In Eq.(3.3.26), represents the sensitivity of the performance function g(X), which 

measures the change in the performance function to the change in the physical random variables. 
However, the sensitivity of the safety index ft represents the change in the safety index due to 


96 



Failure region g(U) < 0 



Fig. 3.8 Sensitivity Factors 
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the change in random variables and the uncertainty, that is, it depends on the sensitivity of 
the performance function and the standard deviation of random variables <r, (from Eq. 

3.3.26). 

In summary, what you are getting by computing the a, is the sensitivity of the safety index 
with respect to u which has two major functions. First, these sensitivity factors show the 
relative contributions of the random variables to the safety index or the failure probability. 
Second, the sign of the sensitivity factor gives the relation between the performance function 
and the physical variables. A positive a, means that the performance function g(U) decreases 
as the random variables increase, and a negative factor means g(U) increases as the random 
variables increase. If you are looking for the sensitivity of the failure probability, it will have 
the same direction, but you need to multiply a,- with the probability density function value 
(Eq. 3.3.33). For example, the limit state function is 

g{ X) = S- S( X) (3.3.34) 

where S is the allowable stress and S(X) is the structural stress. If a, is positive, it means 
J-^- is negative and is positive. In very simplified terms, if the random variable increases, 

S(X) increases and the failure probability increases. 

3.3.2.5 Transformation of Nonnormal Variables 

In the Hasofer-Lind method, the random variables X are assumed as normally distributed. 
Even when the limit state function g(X) is linear, the structural probability calculation given 
in Eq. (3.2.9) is inappropriate in the nonnormal cases. However, many structural reliability 
problems involve nonnormal random variables. It is necessary to find a way to solve these 
nonnormal problems. There are many methods available for conducting the transformation, 
such as Rosenblatt [5], Hohenbichler and Rackwitz [6], etc. A simple and approximate 
transformation called equivalent normal distribution or the normal tail approximation is 
described below. The main advantages of this transformation are: 
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(1) . It does not require the multidimensional integration; 

(2) . Transformation of the nonnormal variables into equivalent normal variables has been 
accomplished prior to the solution of Eqs. (3.3.21) - (3.3.29); 

(3) . Eq. (3.2.9) for calculation of the structural probability is retained; 

(4) . It often yields excellent agreement with the exact solution of the multi-dimensional 
integral of probability formula. When the variables are mutually independent, the 
transformation is given as 

m = ^ >-1 [i ? x i ( x i)] (3.3.35) 

where $ -1 [.] is the reversal of $[.]. F X i(xi) is non-normal and fxi{ x i ) is normal distribution. 

One way to get the equivalent normal distribution is to use the Taylor series expansion of 
the transformation at the MPP X* , neglecting nonlinear terms [7], 


where 


Ui ~ $ _1 [F r ,(x*)] + 1 [Fr i (x,)])U*(^ - x*) 


d -r — 1 r jp / u _ 

tel IF * i(Ii)1 - 


Upon substituting (3.3.37) into (3.3.36) and rearranging, 

_ x, - [x* - ^- 1 [Fx j (xr)]^($- i [Fx,(^)])//„(xr)] 


(3.3.36) 


(3.3.37) 


(3.3.38a) 


which can be written as 



(3.3.386) 


where F x -(x,) is the marginal cumulative distribution function, f Xi (xi) is the probability density 


function, and (i x > and a x > are the equivalent means and standard deviations of the approximate 
normal distributions. They are given as 


(*?)]) 

m = x: - *-'[F Xi {x:)]<T4 


(3.3.39a) 

(3.3.396) 
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Fig. 3.9 Normal Tail Approximation 

Another way to get the equivalent normal distribution is to match the cumulative 
distribution functions and probability density function of the original non-normal and the 
approximate or equivalent normal random variable distributions at the MPP [5]. Assuming 
that x\ is an equivalent normally distributed random variable, the cumulative distribution 
function values of x, and x'- at x* are equal, i.e., 

= F,.(x-) (3.3.40) 

or 

*■«(*?) = (3.3.41) 

cr x > 


100 


so 


(3.3.42) 


Ai«J = 

The probability density function value of x, and x( at x* are equal, i.e., 


/«(*') = /-:(*?) 


(3.3.43) 


or 


= — n — ) 


<7V 




(3.3.44) 


From Eqs. (3.3.42) and (3.3.44), the equivalent mean /* x < and standard deviation a x >. of the 
approximate normal distributions are derived as Eqs.(3.3.39a) and (3.3.39b). This normal tail 
approximation is shown in Fig. 3.9. 

Using Equations (3.3.39a) and (3.3.39b), the transformation of the random variables from 
the X-space to the U-space can be easily performed, and the performance function G(U) in 
U-space is approximately obtained. 


Example 3.4 

x is a random variable having a lognormal distribution. Its mean value and standard 
deviation are /z x = 120 and a x = 12, respectively. Calculate the mean value and standard 
deviation of the equivalent normal distribution variable x' at x* = 80.0402. 

(1) Compute the mean value, /x y , and standard deviation, a y of a normally distributed 
variable y {y = Inx) using Eqs. (1.53) and (1.54) 


= ^ N (^) 2 + 1 ] 

= f^S^ ] 

= 0.09975 
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fly = Infix - 2 °i 

= /nl20 -lx 0.09975 2 

2 

= 4.7825 

(2) Compute the density function value at x* 


/«(*•) 


\/27r. 


1 r 1 , /nx* - 2l 

-exp[— — ( — ^) 2 ] 


WX CTy 


1 . 1 Jn80.0402 - 4.7825 

exp — ( 

v/2tt x 80.0402 x 0.09975 2 V 0.09975 
1.6114 x 10" 5 


(3) Compute the cumulative distribution function value at x* 

From the density function above, it is obvious that the cumulative distribution function can 
be given as 


(4) Compute $ 1 [F r (x*)] 






Ml* — fly 

/n80.0402 - 4.7825 
0.09975 
-4.0098 


(5) Compute 4>($ 1 [F*(x*)]) 


l [F x {x*)}) = -4=exp[- V WX ** v ) 2 ] 

V27 r £ (T y 
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1 . 1 /n80.0402 — 4.7825 . 2 , 

= V^ eXP ^~2^ 0.09975 ’ ' 

= 1.2865 x 10~ 4 

(6) Compute the mean value and standard deviation of the equivalent normal distribution, 
fi x i and < 7 x < using Eqs. (3.3.39a) and (3.3.39b) 

** ~ /-(*•) 

1.2865 x 10" 4 
1.6114 x 10- 5 
= 7.9841 

fi X > = X* — $ _1 [F iE (x*)]<7 a ;/ 

= 80.0402 + 4.0098 x 7.9841 
= 112.0553 

Using fJ. x ‘ and <x r ', the standard normal variable of x can be computed from Eq. (3.3.38b). 

Example 3.5 

x is a random variable having a type-I extreme value distribution. Its mean value and 
standard deviation are (x x = 4 and a x = 1, respectively. Calculate the mean value and standard 
deviation of the equivalent normal distribution variable x at x /x x 4. 

(1) Compute the scale and location parameters, 6 and t 0 , of the type-I extreme value 
distribution for the variable x using Eq. (1.65). In the following expression, /x P , a P , 8, and t 0 
are equivalent to /x x , a x , /?, and 1/a given in Eq. (1.65), respectively. 

t = ° x 
0 1.2825 
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1 

1.2825 
= 0.7797 


6 = p x — 0.5772f o 
= 4 - 0.5772 x 0.7797 
= 3.5499 

(2) Compute the density function value at x * 

/«(**) = -Uxp{-( X - ) - exp[-( X * )]} 
to to r 0 

r .4 — 3.5499. . , 

= 1-2825 x exp{—( - — ■■) - exj>[-( 

= 0.4107 

(3) Compute the cumulative distribution function value at x* 


*■.(*•) 


exp{— exp( 
exp{— exp( 



4 - 3.5499 
0.7797 


0.5704 


(4) Compute $ 1 [F x (x*)] 


$- a [F r (x*)] = [0.5704] 

= 0.177 


(5) Compute 1 [F x (x*)]) 


4- 3.5499 
0.7797 
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^-'{Frix*)}) = #0.177) 

= 0.3927 

(6) Compute the mean value and standard deviation of the equivalent normal distribution, 
fi x i and cr x i using Eqs. (3.3.39a) and (3.3.39b) 

F^jxW 

" /.,(*?) 

0.3927 

0.4107 
= 0.9561 

fi x ; = x* -$ _1 [F Xl (x*)]a x - 

= 4 — $ _1 [0.5704] x 0.956 1 
= 3.8305 

Example 3.6 

x is a random variable having a Weibull distribution. Its mean value and standard deviation 
are fi x = 50 and a x = 5, respectively. Calculate the mean value and standard deviation of the 

equivalent normal distribution variable x' at x* = (i x = 50. 

(1) Compute the parameters, a and /?, of the Weibull distribution for the variable x using 

Eqs. (1.58) and (1.59). 

A _ [Aii-IL _ ll 05 

50 T 2 (i + 1) 
a = 12.1534 
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0 = 


fi X 

r(i + i) 

50 

12.1534 

= 52.1519 


Note: If Eq. (1.60) is used, the approximate parameters can be solved as below: 


a = C~ 1M = (— )“ 108 = 12.0226 


0 = 


fix 


50 


= 52.1728 


r (a + !) r ( 12.0226 + *) 

The approximate parameters are very close to the exact values, so this method can be used 
for practical engineering problems. 

(2) Compute the density function value at x* 


/*(**) = 


ax 


0-1 


— e^[-(-n 

12.1534 x 50 )12 . 1534] 


52.15 1 9 121534 
= 7.9998 -2 


52.1519 


(3) Compute the cumulative distribution function value at x* 


F x (x*) = 


1 - exp[-(-) Q ] 


= 1 — exp [— ( 


50 


52.1519 


^12.1534 


= 0.4508 


(4) Compute $ 1 [F x (x*)] 
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= $" 1 [0.4508] 


= -0.1237 


(5) Compute <f>($ ^^(x*)]) 

= </*(— 0.1237) 

= 0.3959 

(6) Compute the mean value and standard deviation of the equivalent normal distribution, 
fi x i and o x > using Eqs. (3.3.39a) and (3.3.39b) 

C< “ /-,(*?) 

0.3959 

7.9998“ 2 

= 4.9489 

M = x:-^~ 1 [F Xi (x *)K; 

= 50 - $ _1 [0.4508] x 4.9489 
= 50.6123 

3 3.2.6 RF/HL-RF algorithm 

The RF algorithm is similar to the Hasofer-Lind iteration method shown in section 3. 3.2. 2, 
except that the steps 2 and 4 are necessary to implement the calculation of the mean and 
standard deviation of the equivalent normal variables based on Eqs. (3.3.39a) and (3.3.39b). 
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Fig. 3.10 Beam with a Concentrated Load 

The RF method can be also called HL-RF method since the iteration algorithm was originally 
proposed by Hasofer and Lind and later extended by Rackwitz and Fiessler to include random 
vaxiable distribution information. The following example is given to explain the HL-RF 
algorithm. 


Example 3.7 

Consider the plane frame structure shown in Fig. 3.10. Evaluate the safety index and the 
coordinates x* of MPP. The failure principle of the displacement is 

5 PI? L 

48 El ~ 30 

where d max is an allowable maximum displacement, E is Young’s modulus, and I is the bending 
inertial moment of the cross section. The mean values, fip, fiL, PE, Vi, of the load P, the beam 
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length L, the Young’s modulus E . and the inertial moment I are 4 kN, 5 m, 2.0 x 10 kN/m , 
and 10~ 4 m 4 , respectively. The corresponding standard deviations, a P , a L , a E , cri, are 1 kN, 
0 m, 0.5 x 10 7 kN/m 2 , and 0.2 x 10" 4 m 4 . Because a L = 0, L is a deterministic parameter 
(L=5 m). There are three random variables in this example. P is the type-I extreme value 
distribution, and E and I are normal distribution. The limit state function is given as 

El — 78.12P = 0 

(1) Compute the scale and location parameters of the type-I extreme value distribution using 
Eq. (1.65) for the variable P. In the following expression, /zp, a P , and 8 are equivalent to fi x , 
a x and /? given in Eq. (1.65), respectively. 

/zp = <5 + 0.5772/a 
<7p — 1.2825/a 

Substituting /z F = 4k N and a P = 1 kN into the above formulas, the scale and location 
parameters are obtained as 

8 = 3.5499, a = 1.2825 

(2) Iteration 1: 

(a) Compute the mean and standard deviation of the equivalent normal distribution for P: 
First, assuming the design point, X* = {£*,/*, P*} T , as the mean value point, the 
coordinates of the initial design point are 

E* = HE = 2 X 10 7 , r = m = 10~ 4 , P* = /zp = 4 
The density function value at P* is 

/ p (P*) = aexp{ — (P* - 8)a - exp[-(P* - 6)a]} 
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1.2825 • exp{-( 4 - 3.5499) x 1.2825 - exp{-( 4 - 3.5499) x 1.2825]} 
0.4107 


The cumulative distribution function value at P* is 


Fp(P*) = exp{— exp[— (P* — 6)a]} 

= exp{-exp [-( 4 - 3.5499) x 1.2825]} 

= 0.5704 

Therefore the standard deviation and mean value of the equivalent normal variable at P* 
from Eqs. (3.3.44a) and (3.3.44b) are 


gNn ]) 

fp(p-) 

^(S*- 1 [0.5703]) 

0.4107 

0.3927 

0.4107 

0.9561 

0.3927. 


p P , = P* - $- 1 [F P (P*)] < jp- 
= 4 -$ _1 [0.5704] x 0.9561 
= 3.8304 

(b) Compute the function value and gradients of the limit state function at the mean value 
point: 


< 7 p> 


where [0.5704] =0.177 and <£(0.177) = 
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</(£*, /*,0 = El — 78.12P 

= 2 x 10 7 x 10' 4 - 78.12 x 4 
= 1687.52 


dg{X*) = 4 

dE 

dg(X •) 


5 / 

gg(£) 


= 2 x 10 7 
= -78.12 


(c) Compute the initial ft using the mean value method and its direction cosine a, 


g( E^Ejn 

" (M^p!l CT/)2 + { §iiSg£l ap )2 

1687.52 

_ ^/(10 -4 x 0.5 x 10 7 ) 2 + (2 x 10 7 x 0.2 x 10~ 4 ) 2 + (-78.12 x 0.9561) 2 
= 2.6383 


OCE 



'-^■ve ) 2 + ( 


10~ 4 x 0.5 X 10 7 


^/(10~ 4 x 0.5 x 10 7 ) 2 + (2 x 10 7 x 0.2 x 10" 4 ) 2 + (-78.12 x 0.9561) 2 
-0.7756 


a/ = - 
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2 x 10 7 x 0.2 x 10" 4 


^/(10- 4 x 0.5 x 10 7 ) 2 + (2 x 10 7 x 0.2 x 10~ 4 ) 2 + (-78.12 x 0.9561) 2 
= -0.6205 


otp 





-78.12 x 0.9561 

^(lO- 4 x 0.5 x 10 7 ) 2 + (2 x 10 7 x 0.2 x 10" 4 ) 2 + (-78.12 x 0.9561) 2 
0.1159 


(d) Compute the coordinates of the new design point from Eq.(3.3.28): 


E * = + fixCTE&E 

= 2 x 10 7 + 2.6383 x 0.5 x 10 7 x (-0.7756) 

= 9768710.0966 

I* = (il + $\<JlOLl 

= 10" 4 + 2.6383 x 0.2 x 10“ 4 x (-0.6205) 

= 0.6726 x 10~ 4 

P * = fXpi + 

= 3.8304 + 2.6383 x 0.9561 x 0.1159 
= 4.1227 

. E*-he 9768710.0966 - 2 x 10 7 0 

= = — — z.U4uo 

oe 0.5 x 10 7 
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0.6726 x 10' 4 - 10" 4 
0.2 x IQ" 4 



4.1227 - 3.8304 
0.9561 


= -1.6370 
= 0.3057 


(3) Iteration 2: 

(a) Compute the mean and standard deviation of the equivalent normal distribution at P* 
The density function value at P * is 


f P (P*) = otexp{-(P* - 8)a - exp[-{P* - 6)a]} 

= 1.2825 • exp{— (4.1227 - 3.5499) x 1.2825 - exp[-(4.1227 - 3.5499) x 1.2825]} 
= 0.3808 

The cumulative distribution function value at P* is 


Fp(P *) = exp{-exp[-(P* - 8)a]} 

= exp{—exp[— (4.1227 - 3.5499) x 1.2825]} 

= 0.6189 

The standard deviation and mean value of the equivalent normal variable at P m are 

■ fp(p *) 

(^>($- 1 [0.6189]) 

0.3808 

°- 3811 

0.3808 
= 1.0007 

where 1 [0.6189] = 0.3028 and <^>(0.3028) = 0.3811. 


113 



HP' = P* - $- l [Fp{P*)\<rp. 

= 4.1227 - [0.6189] x 1.0007 

= 3.8197 

(b) Compute the function value and gradients of the limit state function at X*(E*,I*,P’) 


g(E%r,n 


EI - 78.12 P 

9768710.0966 x 0.6726 x 10~ 4 - 78.12 x 4.1227 


= 334.9737 


dE 

djvn 

dl 

wn 

dP 


= 6.726 x 10 -5 
= 9768710.0966 
= -78.12 


(c) Compute /? using Eq. (3.3.25) and the direction cosine a, 


_ sjjn - aEaa - 

334.9737 + 672.6 x 0.5 x 2.0463 + 976.87 x 0.2 x 1,6370 + 78.12 x 1.0007 x 0.3057 
-y/ (6.726 x 10- 5 x 0.5 x 10 7 ) 2 + (9768710.0966 x 0.2 x lO” 4 ) 2 + (-78.12 x 1.0007) 2 
= 3.4449 


&E 


§e\^ e 


+ (M^l a/)2 + (M^!l aF)2 

6.726 x 10~ 5 x 0.5 x 10 7 

^(6.726 x 10- 5 x 0.5 x 10 7 ) 2 + (9768710.0966 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.0007) 2 
-0.8477 
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aj = - 

9768710.0966 x 0.2 x 10" 4 

_ ^(6.726 x 10- 5 x 0.5 x 10 7 ) 2 + (9768710.0966 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.0007) 2 
= -0.4925 

a P = - 

-78.12 x 1.0007 

_ v /(6.726 x 10- 5 x 0.5 x 10 7 ) 2 + (9768710.0966 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.0007) 2 
= 0.1971 

(d) Compute the coordinates of the new design point from Eq. (3.3.28): 

E * = he + favEO-E 

= 2 x 10 7 + 3.4449 x 0.5 x 10 7 x (-0.8477) 

= 5398459.5316 

/* = hi + $2 <7i q i 

- 10" 4 + 3.4449 x 0.2 x 10~ 4 x (-0.4925) 

= 0.6607 x 10‘ 4 

P* = HP' + /? 2 cr P' a P 

= 3.8197 + 3.4449 x 1.0007 x 0.1971 
= 4.4990 
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fp(P*) = aexp{-(P* - 6)a - exp[-(P* - 6)a]} 

= 1.2825 • exp{— (4.4990 - 3.5499) x 1.2825 - exp[-(4.4990 - 3.5499) x 1.2825]} 
= 0.2824 

The cumulative distribution function value at P* is 


Fp(P *) = exp{— exp[— (P* — 6)a]} 

= exp{-exp[- (4.4990 - 3.5499) x 1.2825]} 

= 0.7438 

The standard deviation and mean value of the equivalent normal variable at P * are 
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fp(P’) 

<£($-* [0.7438]) 

0.2824 

0.3219 

0.2824 
= 1.13998 


where $ *[0.7438] = 0.65495 and ^(0.65495) — 0.3219. 


up. = 

= 4.4990 - $-*[0.7438] x 1.13998 
= 3.7524 


(b) Compute the function value and gradients of the limit state function at X (E ,1 ,P ) 


g{E*,I\P*) = El — 78.12P 

= 5398459.5316 x 1.3393 x 10" 4 - 78.12 x 4.4990 
« 5.2055 

MjQ = 6.6069 x 10 -5 
d9 ^ — = 5398459.5316 

= -78.12 

dP 

(c) Compute /? using Eq. (3.3.25) and the direction cosine a,- 
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= son - 9 4P^i - - ^p<rp«% 

+ OWn 2 + J^W^y 

5.2055 + 660.69 x 0.5 x 2.9203 + 539.85 x 0.2 x 1.6966 + 78.12 x 1.13998 x 0.6788 
\J (6.6069 x lO" 5 x 0.5 x 10 7 ) 2 + (5398459.5316 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.13998) 2 
= 3.3766 


&E 


8e\^E 




6.6069 x 10~ 5 x 0,5 x 10 7 

^(6.6069 x 10- 5 x 0.5 x 10 7 ) 2 + (5398459.5316 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.13998) 2 
-0.9208 


a/ 




Si 


9g(g*,/»,P») 

9E 


a E ) 2 + ( 


dg{E%I\P* 
di 


V i ) 2 + ( 


a a iE\rj* 

dp 


^crp) 2 


5398459.5316 x 0.2 x 10' 4 

^(6.6069 x 10" 5 x 0.5 x 10 7 ) 2 + (5398459.5316 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.13998) 2 
-0.3009 


ocp 


§pL°jp 


-78.12 x 1.13998 


^(6.6069 x lO" 5 x 0.5 x 10 7 ) 2 + (5398459.5316 x 0.2 x 10" 4 ) 2 + (-78.12 x 1.13998) 2 
0.2482 


(d) Compute the coordinates of the new design point from Eq.(3.3.28): 


E * = he + /33<?e(*e 

= 2 x 10 7 + 3.3766 x 0.5 x 10 7 x (-0.9208) 
= 4454699.4278 
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I* = hi + filial 

= 1CT 4 + 3.3766 x 0.2 x 10 -4 x (-0.3009) 
= 0.7968 x 10" 4 


P* - hp + #3 crpap 

= 3.7524 + 3.3766 x 1.13998 x 0.2482 
= 4.7079 


u E — 


E“ — he 

4454699.4278 - 2 x 10 7 


0.5 x 10 7 

I* — Hi 

0.7968 x 10" 4 - 10" 4 _ 

cri 

0.2 x 10~ 4 

i 

» 

a, 

l 

O' 

H P , 4.7079 - 3.7524 __ 


<7 pi 


1.13998 


= -3.1091 
: -1.0162 
0.8381 


(e) Check /? convergence 


_ |fe - ftj = 13.3766 - 3.4449| = 0198 
* ft 3.4449 

Since e > e r (0.001), continue the process. 

(5) Iteration 4: 

(a) Compute the mean and standard deviation of the equivalent normal distribution at P* 
The density function value at P* is 


f P (P*) = aexp{-{P* - S)a - exp[-(P* - <$)<*]} 

= 1.2825 • errp{ — (4.7079 - 3.5499) x 1.2825 - exp[-(4.7079 - 3.5499) x 1.2825]} 

= 0.2316 
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The cumulative distribution function value at P* is 


F P (P*) = exp{-exp[-(P* - 6)a}} 

= exp{-exp[-(4.7079 - 3.5499) x 1.2825]} 

= 0.7973 

The standard deviation and mean value of the equivalent normal variable at P * are 

_ 

F ' fp(P*) 

^(S" 1 [0.7973]) 

0.2368 

0.2822 

0.2368 

= 1.2184 


where [0.7973] = 0.8321 and <£(0.8321) = 0.2822. 


HP< = P* - $- l [Fp(P*)}a P . 

= 4.7079 - [0.7973] x 1.2184 

= 3.6939 

(b) Compute the function value and gradients of the limit state function at X*(E*, /*, P*) 


g(E*,I*,P*) 


El — 78.12P 

4454699.4278 x 0.7968 x 10~ 4 - 78.12 x 4.7079 
-12.8426 
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= 7.9676 x 10~ 5 

dE 

= 4454699.4278 

dl 

= -78.12 

dP 


(c) Compute j3 using Eq. (3.3.25) and the direction cosine c* t - 

_ - ’-IP'p* 

— 12.8 426 + 796.76 x 0.5 x 3.1091 + 445.47 x 0.2 x 1.0162 + 78.12 x 1.2184 x 0.8381 
^/(7.9676 x 10~ 5 x 0.5 x 10 7 ) 2 + (4454699.4278 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.2184)* 
= 3.3292 


7.9676 x 10~ 5 x 0.5 x 10 7 

_ ^(7.9676 x 10- 5 x 0.5 x 10 7 ) 2 + (4454699.4278 x 0.2 x 10" 4 ) 2 + (-78.12 x 1.2184) 2 
-0.9504 


§/l<7/ _ 

2 + + (M 

4454699.4278 x 0.2 x 10~ 4 

_ ^(7.9676 x 10- 5 x 0.5 x 10 7 ) 2 + (4454699.4278 x 0.2 x 10' 4 ) 2 + (-78.12 x 1.2184) 2 
-0.2125 




-78.12 X 1.2184 

”^(7.9676 x 10- 5 x 0.5 x 10 7 ) 2 + (4454699.4278 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.2184) 2 
= 0.2271 
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(d) Compute the coordinates of the new design point from Eq.(3.3.28) 


E* = f*l E + 0 \Ve&e 

= 2 x 10 7 + 3.3292 x 0.5 x 10 7 x (-0.9504) 
= 4179859.5780 

r = m + p^ioti 

= 10" 4 + 3.3292 x 0.2 x 10~ 4 x (-0.2125) 
= 0.8585 x 10" 4 


P* = Hp + /3 4 crpap 

= 3.6939 + 3.3292 x 1.2184 x 0.2271 
= 4.6151 


. E * - he 4179859.5780 - 2 x 10 7 

u e = — 1 — = . — = -3.1640 


Ut — 


&e 0.5 x 10 7 

/* - hi 0.8585 x 10~ 4 - 10~ 4 


Up = 

(e) Check 0 convergence 


cri 

P * ~ HP' 


O pt 


0.2 x 10~ 4 
4.6151 - 3.6939 
1.2184 


= -0.7076 
= 0.7560 


l/?4 ~ 0 ^ 

03 


3.6939 - 3.3766 
3.3766 


0.094 


Since e > £ r (0.001), continue the process. 
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(6) Iteration 5: 

(a) Compute the mean and standard deviation of the equivalent normal distribution at P 
The density function value at P * is 

f P (P*) = aexp{-(P* - 6)ot - exp[-(P* - 8)a}} 

= 1.2825 • exp{-{ 4.6151 - 3.5499) x 1.2825 - exp[-(4.6151 - 3.5499) x 1.2825]} 
= 0.2535 

The cumulative distribution function value at P* is 

Fp(P*) = exp{-exp[-(P* - 6)oc\] 

= exp{—exp[— (4.6151 - 3.5499) x 1.2825]} 

= 0.7748 

The standard deviation and mean value of the equivalent normal variable at P are 

fplf) 

<£($-* [' 0.7748]) 

0.2535 
0.3000 

0.2535 

= 1.1835 

where [0.7748] = 0.7548 and <£(0.7548) = 0.3000. 

lip, = P* - $- 1 [Fp(P m )]<r P ' 

= 4.6151 - $ -1 [0.7748] x 1.1835 
= 3.7217 
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(b) Compute the function value and gradients of the limit state function at X*(E*,I*,P*) 


g(E m ,I\P *) = El -78.12P 

= 4179859.5780 x 0.8585 x 10" 4 - 78.12 x 4.6151 
= -1.6961 


dg{X') 

dE 

dgjxn 

dl ~ 
dg(X') 


= 8.5848 x 10' 


= 4179859.5779 


= -78.12 


(c) Compute P using Eq. (3.3.25) and the direction cosine a. 


_ g (£) - _ _ Mp apu - P 

+ ( aj %P*rr 

-1.6961 + 858.48 x 0.5 x 3.1640 + 417.98 x 0.2 x 0.7 076 + 78.12 x 1.1835 x 0.7560 

^(8.5848 x 10- 5 x 0.5 x 10 7 ) 2 + (4179859.5779 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.1835) 2 
= 3.3232 
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4179859.5779 x 0.2 x 10~ 4 

~ ^(8.5848 x 10- 5 x 0.5 x 10 7 ) 2 + (4179859.5779 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.1835) 2 
= -0.1870 


dPW 


a P = - 


ap 


-78.12 x 1.1835 


^(8.5848 x 10- 5 x 0.5 x 10 7 ) 2 + (4179859.5779 x 0.2 x 10" 4 ) 2 + (-78.12 x 1.1835) 2 
= 0.2068 


(d) Compute the coordinates of the new design point from Eq.(3.3.28): 


E* = he + /?5 &E&E 

= 2 x 10 7 4- 3.3232 x 0.5 x 10 7 x (-0.9603) 
= 4043172.7300 


7* = m + filial 

= 10~ 4 + 3.3232 x 0.2 x 10 -4 x (-0.1870) 
= 0.8757 x 10 -4 


P* = HP + Ps <j p°‘p 

= 3.7217 + 3.3232 x 1.1835 x 0.2068 

= 4.5352 

E* -he _ 4043172.7300 - 2 x 10 7 _ _ 3 
U * E = V E “ 0.5 xlO 7 
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. /* - Hi 0.8757 x 10~ 4 - 10" 4 

«/ = — = — t = -0.6215 


(e) Check 0 convergence 


Vi 

0.2 x 10- 4 

_ P* — pp' 

_ 4.5352 - 3.7217 

(7 pi 

1.1835 

IA - Al 

|3.3232 - 3.6939| 


0.1 


04 3.6939 

Since e > £ r (0.001), continue the process. 

(7) Iteration 6: 

(a) Compute the mean and standard deviation of the equivalent normal distribution at P* 
The density function value at P* is 


/p(P’) = aexp{ — (P* — S)a — exp[— (P* — £)<*]} 

= 1.2825 • exp{— (4.5352 - 3.5499) x 1.2825 - exp[-(4.5352 - 3.5499) x 1.2825]} 
= 0.2732 


The cumulative distribution function value at P* is 


Pp(P*) = exp{— exp[— (P* — £)<*]} 

= exp{—exp[— (4.5352 - 3.5499) x 1.2825]} 

= 0.75380 

The standard deviation and mean value of the equivalent normal variable at P* are 


fl*- 1 [*>(***)]) 
fp(P') 

^(fc- 1 [0.7538]) 
0.2732 
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0.3152 
0.2732 
= 1.1535 


where $ _1 [0.7538] = 0.6865 and <^>(0.6865) = 0.3152. 


= P* -*- 1 [Fp{P m )]<r P ' 

= 4.5352 - S" 1 [0.7538] x 1.1535 
= 3.7433 


(b) Compute the function value and gradients of the limit state function at 


X*{E m ,I\P*) 


g(E-,I*,P *) = El — 78.12P 

= 4043172.7300 x 0.8757 x 10' 4 - 78.12 x 4.5352 

= -0.2352 


dg ^ X 1 = 8.7569 x 10 -5 

dE 

dg ( X D. = 4043172.7299 
dl 


dP 


= -78.12 


(c) Compute /? using Eq. (3.3.25) and the direction cosine a t 


@6 = 


g(X*) - ^P-oev-e ~ Z ZdP^t 

i^) 2 + (^^) 2 + 

-0.2352 + 875.69 x 0.5 x 3.1914 + 404.32 x 0.2 x 0.621 + 78.12 x 1.1535 x 0.6874 
= ^(8.7569 x 10- 5 x 0.5 x 10 7 ) 2 + (4043172.7299 x 0.2 x 10' 4 ) 2 + (-78.12 x 1.1535) 2 

= 3.3222 
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&E 



8.7569 x 10~ 5 x 0.5 x 10 7 


yf{ 8.7569 x 10- 5 x 0.5 x 10 7 ) 2 + (4043172.7299 x 0.2 x 10" 4 ) 2 + (-78.12 x 1.1535) 2 
-0.9638 


ai 


I 

+ ( M W 11 ^ 2 


4043172.7300 x 0.2 x 10" 4 

^(8.7569 x 10- 5 x 0.5 x 10 7 ) 2 + (4043172.7299 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.1535) 2 
-0.1780 


a P 


§p\» a P 


v/ (M^!i aE ) 2 + (i + 

-78.12 x 1.1535 


^(8.7569 x 10- 5 x 0.5 x 10 7 ) 2 + (4043172.7299 x 0.2 x 10~ 4 ) 2 + (-78.12 x 1.1535) 2 
0.1984 


(d) Compute the coordinates of the new design point from Eq.(3.3.28): 


E* = /i# + flea e&e 

= 2 x 10 7 + 3.3222 x 0.5 x 10 7 x (-0.9638) 
= 3989701.3284 

r = m + /? 6 < t / q ;/ 

= 10' 4 + 3.3222 x 0.2 x 10 -4 x (-0.1780) 
= 0.8817 x 10" 4 
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P* = HP + 06 crpap 

= 3.7433 + 3.3222 x 1.1535 x 0.1984 

= 4.5035 


u E — 


E* - HE _ 3989701.3284 - 2 x 10 7 __ _ 3 




0.5 x 10 7 

1-4 i n -4 


2021 


u, 


I* — Hi 0-8817 x 10- 4 - IQ" 4 = _ Q 59U 
0.2 x 10- 4 


<n 


U p — 


P* — HP 1 _ 4. 5035 — 3.7433 _ n 
1.1535 


CTp/ 


(e) Check /3 convergence 


\06 ~ ^5 1 _ |3. 3222 3.3232] _ ^ qqqcj 

£ ” p 5 “ 3.3232 

Since e < e r (0.001), stop the process. 

The safety index fi is 3.3222. Since the limit state function value at the MPP X * is close to 
zero, this safety index can be considered as the shortest distance from the origin to the limit 

state surface. 

A computer program based on the RF algorithm is developed to perform the reliability 
analysis. The flow-chart of the program is given in Fig. 3.11. 

3.3.3 Efficient Safety Index Algorithms Using Appro ximations 

Based on the linear, conservative, TANA [8] and TANA2 [10] approximations described in 
the previous section, the following safety index algorithms and a corresponding computer code 
AURORA (Approximations Used to Rapidly Obtain Reliability Analysis) have been developed. 
The flow-chart of the safety index algorithms using approximations is shown in Fig. 3.12. 
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Fig. 3.11 Flow-chart of RF/HL-RF Method 
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Fig. 3.12 Flow-chart of the Safety Index Algorithms using Approximations 
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3.3.3. 1 Approximate Limit State Function Using Linear Approximation fRF/HL-RF Method^ 

The algorithm based on the linear approximation is the same as the RF method. The limit 
state function is approximated as Eq. (3.3.23) at the MPP, and the safety index is obtained 
by solving iteratively the reliability problem given in Eq. (3.3.20). More details are given in 
Sections 3. 3. 2. 2 and 3. 3. 2. 6. 

3.3. 3.2 Approximate Limit State Function Using Conservative Approximation 

In the previous algorithm, the hypersurface G(U) was approached by the first-order Taylor 
expansion at the MPP. For nonlinear problems, this approach is only an approximation, and 
several iterations axe usually required. How fast the algorithm converges depends on how 
well the linearized limit state function approximates the nonlinear function g{U). Since 
the conservative approximation has the advantage of including the linear and reciprocal 
approximations in the formulation, a safety index algorithm using conservative approximation 
is presented in AURORA. 

The limit state function is approximated by the conservative approximation of Eqs. (2.3.7) 
and (2.3.8). The safety index model of Eq. (3.3.20) becomes: 

Minimize : P(U) = ( U T U ) 1 ^ 2 (3.3.45a) 

Subject to : g(U) = g(U k ) + - x iyk ) = 0 (3.3.456) 

■_1 OXi 

The main steps of this algorithm are summarized below: 

1) . For the first iteration, construct a linear approximation of Eq. (3.3.23) by using the 
first-order Taylor’s series expansion about the mean values, fj,; 

2) . Compute the most probable failure point X k and safety index /3 k using the HL-RF 
method in U-space, U ; 

3) . Obtain the nonlinear approximation of Eq. (3.3.45b) 

4) . Find the most probable failure point A* +1 of the nonlinear approximation function g(U) 
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and safety index /? fe+1 using the HL-RF method or DOT (Design Optimization Tools) [11], and 
denote X k +i as the current point and X k as the previous point; 

5) . Check the convergence 

i Pk + 1 — /?fc | 

£ = | — 5 “ 1 

6) . Go to step (3) and repeat the process until e is less than the allowable value. 

In step (4), the safety index @ can be easily obtained only by computing the explicit function 
g{U) given in Equation (3.3.45b), in which any optimization scheme or iteration algorithm can 
be used. The computation of the exact performance function g{U) is not required; therefore 
, the computer time can be reduced for problems involving complex and implicit performance 
functions if the conservative approximation provides good accuracy. 

3. 3. 3.3 Approximate Limit State Function Usin g Two-point Adaptive Nonlinea r 

Approximation ('TANA') 

The previous algorithms 1 and 2 both used the fixed approximation models to represent 
the limit state functions. Even though the conservative approximation can be either a linear 
or reciprocal approximation, the truncation errors of the approximations might be so large 
that the algorithm may converge very slowly or even result in divergence for some complicated 
highly nonlinear problems. Therefore, the use of adaptive approximations for different types 
of problems is necessary and important. The adaptive approximations are constructed by 
using the first-order Taylor series expansion in terms of adaptive intervening variables. The 
nonlinearity of the adaptive approximations is automatically changed by using the known 
information generated during the iteration process. 

Based on the two-point adaptive nonlinear approximation (TANA) given in Eq. (2.4.3), the 
safety index model of Eq. (3.3.20) is obtained as 
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Minimize : /?(£/) — ( U T U ) 1/ ^ 2 


(3.3.46a) 


Subject to : g(U) — 0 


(3.3.466) 


where g(U ) is the approximate U-space limit state surface and computed as follows. First, the 
adaptive approximate limit state surface in X-space is obtained as 


g(x ) = g(x t ) + -<k) 


r r= i 


dxi 


(3.3.47) 


then, g(X) is mapped into g(U) by using the standard normal or equivalent normal 
transformations, 


g{U ) =g{cr x 'Ui + /X*/ , <7 r » U 2 + t* x ' 2 , ..-,cr<«n + fix’J 
The nonlinear index r in Eq.(3.3.47) can be determined from Eq. (2.4.2), i.e, 

g(X k . t ) - {,(*») + - <,*)} = 0 

' t* = l OX{ 


(3.3.48) 


(3.3.49) 


In AURORA, r is numerically calculated by minimizing the difference between the exact and 
approximate limit state function at the previous point Xk-\ ■ In theory, r can be any positive 
or negative real number (not equal to 0). r is restricted from -5 to 5 for the X-space iterations 
in AURORA. The X-space and U-space iterations given in AURORA represent the safety 
index algorithms in X-space and U-space, respectively. In X-space iterations, the limit state 
function is approximated in the original space of the random variables (X-space), then the 
approximation is transferred into U-space. In Y-space iterations, the limit state function is 
directly approximated in U-space. The details of X-space and U-space iterations are given 
later in this section. The iteration searching for r starts from r = 1. When r is increased 
or decreased a step length (0.1), the difference e between the exact and approximate function 
is calculated. If e is smaller than the initial error (e.g. corresponding to r = 1), the above 
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iteration is repeated until the allowable error £ = 0.001 or limitation of r is reached, and the 
nonlinear index r is determined. Otherwise, r is decreased by a half and the above iteration 
process is repeated until the final r is obtained. This search is computationally inexpensive 
because Eq. (3.3.49) is available in closed form and very easy to implement. 

Usually, the adaptive safety index algorithm is better than the RF method because the 
nonlinear index r is determined by comparing the linear approximation (starting from 1) and 
minimizing the difference between the exact and approximate limit state functions. In the 
process of searching for r, the nonlinear index will automatically become 1 if other values of r 
can not provide any improvement over the linear approximation. 

The main steps of this algorithm are summarized as follows: 

1) . In the first iteration, compute the mean and standard deviation of the equivalent normal 
distribution at the mean value point for nonnormal distribution variables. Construct a linear 
approximation of Eq. (3.3.23) by using the first-order Taylor’s series expansion at an initial 
point (if the initial point is selected as the mean value point, /x, the linear approximation is 
expanded at /x), and compute the limit state function value and gradients at the initial point; 

2) . Compute the initial safety index fa using the HL-RF method and its direction cosine 
ati (if the initial point is the mean value point, the mean value method is used); 

3) . Compute the new design point using Eq. (3.3.28), X k \ 

4) . Compute the mean and standard deviation of the equivalent normal distribution at X fc 
for nonnormal distribution variables. Calculate the limit state function value and gradients at 
the new design point, Xk\ 

5) . Determine the nonlinearity index r by solving Eq. (3.3.49) based on the information of 
the current and previous points (when k equals to 2, previous design point is the mean value 

*); 

6) . Obtain the adaptive nonlinear approximation of Eq.(3.3.47); 

7) . Transform the X-space approximate limit state function into the U-space function using 
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Eq. (3.3.48); 

8) . Find the most probable failure point Xk+i of the approximate safety index model given 
in Eq. (3.3.46) using the HL-RF method or DOT and compute the safety index 0k+i‘, 

9) . Check the convergence 

_ | 0k+i - 0k | 

' 0k ' 

10) . Stop the process if e satisfies the required convergence tolerance (0.001), otherwise, 
Continue; 

11) . Compute the exact limit state function value and approximate gradients at Afc +1 , and 
estimate the approximate safety index 0k+\ using the HL-RF method; 

12) . Approximate 0 convergence check 

_ \0k+\ ~ 0k\ 

0k 

13) . Continue the process if e satisfies the required convergence tolerance (0.001), otherwise, 
stop; 

14) . Compute the exact gradients of the limit state function at Xk+i and go to step 5); 
repeat the process until 0 converges. 

In step (8), the safety index 0 of the approximate model given in Eq. (3.3.46) can be easily 
obtained only by computing the explicit function g(U), in which any optimization scheme or 
iteration algorithm can be used. The computation of the exact performance function g{X) is 
not required; therefore , the computer time is greatly reduced for problems involving complex 
and implicit performance functions, particularly with finite element models. 

Example 3.8 

This example is the same as Example 3.3b. The safety index algorithm using TANA is used 
to solve 0. 
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(1) Iteration 1: 

(a) Set the mean value point as an initial design point and required /? convergence tolerance 
as e r = 0.001. Compute the limit state function value and gradients at the mean value point 

g{X m ) = < 7 (/ w * 2 ) = / 4 +/ 4-18 
= 10.0 3 + 9.9 3 - 18 
= 1952.299 

p-L = 3 (4 = 3 x 10 2 = 300 

UX\ 

p-l = 3/4 = 3 x 9.9 2 = 294.03 

OX 2 

(b) Compute the initial /3 using the mean value method and its direction cosine a, 


01 




g(£) 


1952.299 


^(300 x 5.0) 2 + (294.03 x 5.0) 2 
0.9295 




9xi 


dgUi I, , 

9xi 


7 Xl 


) 2 + 


300 x_5 1 0 

^/(300 x 5.0) 2 + (294.03 x 5.0) 2 
-0.7142 
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<*2 


d£_ 

8 x 2 f* 


^X 2 


,Mx 2 ) 

9 xi 


'Xi , 


I / dg<Mx, ,/Xx^ ) 

' 9x2 


X 2 , 


294.03 x 5.0 

^(300 x 5.0) 2 + (294.03 x 5.0) 2 
-0.6999 


(c) Compute a new design point X* from Eq. (3.3.28) 


Xj — Hxi "f" P\<? Xi Cl\ 

= 10.0 + 0.9295 x 5.0 x (-0.7142) 
= 6.6808 


^2 — 4 “ P\Vx 2 a 2 

= 9.9 + 0.9295 x 5.0 x (-0.6999) 
= 6.6468 


(2) Iteration 2: 


u n 


U o 


Xi - Vxi 
&X\ 

x; - HX2 


a 


*2 


6.6808 - 10.0 
5.0 

6.6468 - 9.9 
5.0 


-0.6638 

-0.6506 


(a) Compute the limit state function value and gradients at X * 


g{X‘) = g{x *, x * 2 ) = xf + xf - 18 
= 6.6808 3 + 6.6468 3 — 18 
= 573.8398 
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2L\ u = 3x{ 2 = 3 X 6.6808 2 = 133.8982 
dx x ^ 1 

*tL\ u = Zxf = 3 X 6.6468 2 = 132.5409 
dx 2 2 

(b) Compute the nonlinearity index r based on the function values and gradients of the two 
points **(10.0,9.9) and X*(6.6808, 6.6468) using Eq. (3.3.49), that is 


giXk-i) - {g{X k ) + 


< 


where Xjt-i=/^(10.0, 9.9) and Xk—X 


1 V- r _ r \1 

I 2^ x iM x >,k)i 


t=i 


1952.299 - {573.8398 + - • 

r 

[6.6808 1_r x 133.8982 x (10 r - 6.6808 r ) + 
6.6468 1-r x 132.5409 x (9.9 r - 6.6468 r )] 
0.001 

(6.6808,6.6468). 


Using the adaptive search procedure mentioned before, r can be solved as r - 3.0. 

(c) Construct the two-point adaptive nonlinear approximation (TANA) using Eq. (3.3.47) 


9(X) 


, ru lf . -r d 9(X k ) ) 

= 9{Xk) + ~2^, X i,k Q x . k X i Xi - k > 


7 Ui 


= 573.8398 + - • [6.6808 -2 x 133.8982 x (x 3 - 6.6808 3 ) + 
3 

6.6468 -2 x 132.5409 x (x 3 - 6.6468 3 )] 


= x 3 + x 3 — 18.0 

(d) Transfer the above X-space approximate limit state function into the U-space function 
using Eq. (3.3.48) 


g(U) = g(<?X !«1 +/**!> ^* 2 W 2 + Mxa) 
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= (5rn + 10) 3 + (5m + 9.9) 3 - 18. 


(e) Find the most probable failure point X* of the approximate safety index model given 
in Eq. (3.3.46) using DOT 

After four iterations, the MPP point is found as 


x\ = 2.0718, 
u\ = -1.5856, 


(f) Compute the safety index /? 2 


x\ = 2.0883 
u* = -1.5623 


= \ju\ 2 + U 2 2 

= ^/(— 1.5856) 2 + (—1.5623) 2 
= 2.2260 


(g) Convergence check 


, _ | A -0i\ _ 2.2260 - 0.9295 
£ “ A “ 0.9295 

Since e > £ r (0.001), continue the process. 

(3) Iteration 3: 

(a) Compute the limit state function value at X* 


1.3948 


g(x-) = $(*;,*;) = *; 3 + x; 3 - is 
= 2.0718 3 + 2.0883 3 - 18 
= -0.1276 x 10" 5 

(b) Compute approximate gradients using the approximate limit state function 


140 



Y~\* = 3xf = 3 x 2.0718 2 = 12.8769 
^-\ tl = 3xf = 3 x 2.08 83 2 = 13.0832 

OX 2 

(c) Compute approximate safety index 0 using the HL-RF method (Eq. 3.3.25) and the 
direction cosine a, 


«(*•) - 

v /( 2 C i -.,) 2 + (^^) 2 

-0.1276 x 10" 5 - 12.8769 x 5 x -1.5856 - 13.0832 x 5 x -1.5623 
-i/ (12.8769 x 5) 2 + (13.0832 x 5) 2 


= 2.2258 


(d) Approximate convergence check 


£ _ Ift-ftl . 12.2258 - 2.2260 1 = 0 0 qoo9 
02 2.2260 

Since e < £ r (0.001), stop the process. The final safety index is 2.2258. Compared with the 
result of Example 3.3b (0 = 1.1657), the safety index algorithm using TANA is much more 
efficient for this example. It only needs 3 g-function and 2 gradient calculations to reach the 
convergent point. Since the g-function value is very small, the final MPP is on the limit state 
surface. 

In the above algorithm, the nonlinear approximation of the limit state function is performed 
in the original space of the random variables, hence the nonlinear approximation only represents 
the nonlinearity of the performance function in X-space and does not include the nonlinearity 
of the distribution transformation. In general, the nonlinearity of the transformed performance 
function g(U) depends not only on the nonlinearity of the performance function in original space 
but also on the distribution transformation. Even a linear performance function in X-space may 
result in a nonlinear performance function in U-space because of the transformation. Therefore, 
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directly approximating the transformed performance function g(U) of U-space instead of g(X) 
in X-space may be closer to the exact function for non-normal distributions. However, for 
U-space approximation, the intervening variables (Eq. 2.4.1) may become impractical because 
the standard variables in U-space are usually negative. 

In order to construct an adaptive nonlinear approximation in U-space, improved intervening 
variables are denoted as Y = {yi,y2, ■■■y n ) T ■ 


Vi = ( Ui + —s) i = 1,2, ...,n (3.3.50) 

<*Xi 

where u, (z = l,2,...,n) is the standard normal variable, \i X{ (i = 1,2, ...,n) is the mean value, 
a Xi (z = 1, 2, ..., n) is the standard deviation, r is the nonlinearity index, which mainly controls 
the functional nonlinearity, and s is the coefficient of coordinates shift which preserves the 
positiveness of normal coordinates and gives an additional degree of freedom for improving 
the accuracy. Both parameters, r and s can be selected appropriately by using the following 
feedback formula based on two analyses information at Yk-i and Yk ( Yk is the current point 
and Yk - 1 is the previous point). 


g{Yk- 1) - {g(Yk) + + ;r 5 ) - K* + ;r 5 ) ]} = 0 (3.3.51) 

This equation has two unknown parameters r and s, which can be optimally determined by 
minimizing the error e. In theory, the nonlinearity index r can be any positive or negative real 
number (not equal to 0), and the coefficient of coordinates shift s can be selected as any positive 
number (for simplicity it is selected as positive integer in this work). However, the nonlinearity 
index r increases fast when s increases, which may result in large r if s has a larger value for 
some problems. Therefore, in the algorithm implementation, r is restricted from -20 to 20, and 
the shift s is restricted from 1 to 15 for non-normal distributions (s is selected as 1 for normal 
distributions). The iteration for calculating r and s starts from r = 1 and s = 1. When r is 
increased or decreased a step length (0.1), s is changed from 1 to 15, and a combination of r 
and s with the smallest error £ is obtained. If this error is smaller than the initial error (e.g. 
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corresponding to r = 1 and s = 1), the above iteration is repeated until the allowable error 
e = 0.001 or limitation of r is reached, and the optimum combination of r and s is determined. 
Otherwise, the step length of r is decreased by a half and the above iteration process is repeated 
until the final r and s are obtained. 

Based on the above intervening variables given in Eq. (3.3.50), the nonlinear approximation 
in U-space can be obtained from the following equation 


m = m) +;E»Sr ,2 $pK«‘ + !*)' - (“■■* + **>'i ( 3 - 3 - 52 > 


The main steps of this U-space safety index algorithm are summarized as follows: 

(1) In the first iteration, construct a linear approximation to the original performance 
function by using a first-order Taylor’s series expansion about the mean values of the random 
variables, fi] 

(2) Transfer the original random variables in X-space to the standard normal variables in 
U-space by using the approximate distribution transformation of Eq.(3.3.39); 

(3) Compute the most probable failure point Uk and safety index /?* using the RF method 


in U-space; 

(4) Establish the feedback formula of U-space Eq. (3.3.51) by using the intervening variables 
of Eq. (3.3.50) and the first-order Taylor’s series expansion based on the information of the 

current point Uk and the previous point Uk—\-> 

(5) Determine the optimum combination of the nonlinearity index r and the coefficient s 

by minimizing the error £ of Eq. (3.3.51); 

(6) Construct the nonlinear approximation of the performance function (3.3.52) based on 
the intervening variables Eq. (3.3.50); 

(7) Find the most probable failure point U k of the nonlinear approximate function g(U) and 
the safety index /?* using the HL-RF or DOT; 
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(8) Check the convergence 

r _ | Pk ~ Pk-\ , 

If the convergence is not satisfied, go to step (9); 

(9) Compute the exact value of the g-function at t/j. and using this value and the approximate 
gradients obtained from g(U) solve for the safety index /3 a ; 

(10) Check the convergence 



If the convergence is not satisfied, compute the exact gradients, and go to step (4) and repeat 
the process until convergence is reached. 

A significant reduction in computer effort results from the use of the approximate function 
in step (7). Exact function evaluation is avoided and g(U) given in Eq. (3.3.52) is used to 
solve the function value and gradients. This method is particularly suitable for problems with 
highly nonlinear and implicit performance functions needing large scale finite element models 
for structural analysis. 



The difference between this algorithm and the above algorithm is that the limit state 
function is approximated by the TANA2 approximation given in Eq. (2.4.9) since TANA2 
provides better accuracy in some complex cases. The main steps of the X-space algorithm 
using TANA2 axe summarized as follows: 

1). In the first iteration, compute the mean and standard deviation of the equivalent normal 
distribution at the mean value point for nonnormal distribution variables. Construct a linear 
approximation of Eq. (3.3.23) by using the first-order Taylor’s series expansion at an initial 
point (if the initial point is selected as the mean value point, //, the linear approximation is 
expanded at /u), and compute the limit state function value and gradients at the initial point; 
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2) . Compute the initial safety index ft using the HL-RF method and its direction cosine 
ctj (if the initial point is the mean value point, the mean value method is used); 

3) . Compute the new design point using Eq. (3.3.28), X k \ 

4) . Compute the mean and standard deviation of the equivalent normal distribution at X k 
for nonnormal distribution variables. Calculate the limit state function value and gradients at 
the new design point, X k ; 

5) . Determine the nonlinearity index p k {k = 1,2 , ..., JV) by solving Equations (2.4.10) 
and (2.4.11) based on the information of the current and previous points (when k equals to 2, 

previous design point is the mean value X ) , 

6) . Obtain the adaptive nonlinear approximation of Eq. (2.4.9); 

7) . Transform the X-space approximate limit state function into the U-space function using 
Eq. (3.3.48); 

8) . Find the most probable failure point X k+ \ of the approximate safety index model given 
in Eq. (3.3.46) using the HL-RF method or DOT and compute the safety index ft +1 ; 

9) . Check the convergence 

I ft?+ 1 ftc I 

£ - 1 ft 1 

10) . Stop the process if £ satisfies the required convergence tolerance (0.001), otherwise, 
Continue; 

11) . Compute the exact limit state function value and approximate gradients at X k +u and 
estimate the approximate safety index ft+i usin S the HL-RF method; 

12) . Approximate (3 convergence check 

|ft+i ~ ftl 
£ " ft 

13) . Stop the process if e satisfies the required convergence tolerance (0.001), otherwise, 
Continue; 
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14). Compute the exact gradients of the limit state function at Xk+i and go to step 5); 
repeat the process until 0 converges. 

In step (8), the safety index 0 is iteratively computed for the explicit approximate function 
g{X). Any iterative algorithm can be used for finding the MPP. The computation of the exact 
performance function g(X ) is not required; therefore, the computer time is greatly reduced for 
problems involving complex and implicit performance functions, particularly with finite element 
models. 

Example 3.9 

The performance function is 

g{x i,x 2 ) = x x x 2 — 1400 

in which and x 2 are the random variables with lognormal distributions. The mean values 
and standard deviations of two variables are: / i Xl = 40.0, fi X2 = 50.0, a Xl = 5.0, cr X2 = 2.5. The 
safety index algorithm using TANA2 is used to solve the safety index 0. 

(1) Compute the mean values and standard deviations of a normally distributed variables 
V\ and y 2 (y 1 = Inx i, y 2 = lnx 2 ) using Eqs. (1.53) and (1.54), 

= MPr? + 1 ] 

V H'X 1 

= f0 2+i i 

= 0.1245 


= ^ n [(^) 2 + 1 ] 

V r l X2 

= 1 
= 4.9969 x 10" 2 
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H Vl — lnfi Xl ^cr yi 

= Zn40 -\x 0.1245 2 

z 

= 3.6811 


i 2 

fi V2 = lnfi'X2 — 2 <Jy2 

= /n50 - ^ x (4.9969 x 10" 2 ) 2 
= 3.9108 

(2) Iteration 1: 

(a) Compute the mean values and standard deviations of the equivalent normal distributions 
for Xi and X 2 - 

First, assuming the design point, X* = {xl,x* 2 } T , a is the mean value point, the coordinates 
of the initial design point are 


x\ = Hxi = 2 x 40.0, x\ — — 50*0 

The density function values at x\ and x* 2 are 


/«(*;) = 




r l/^ nx l Myi \2] 
-exp[--{ j J 


yi 


'y\ 


V^x 40 X 0.1245 expl 2 ( 


lJn40- 3.6811 


0.1245 


) 2 ] 


= 7.9944 


-2 


1,AA) = 




2 a V2 


-exp[--( 


1 . ITIX*^ fJ>y 2 


) 2 ] 


'V2 
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= I exv \ 1 >50 -3.9108 

V2tc x 50 x 4.9969 x 10~ 2 1 2 V 4.9969 x 10~ 2 ; ] 

= 0.1596 


V 2n 2 . <7 V1 

1 r 1 ,/n40 — 3.6811 . 2l 
= W" A ~2 { 0.1245 >1 

= 0.3982 


«*-'[*•„(*;)]) = "” ) 2 ) 

1 r 1 Jn50 - 3.9108 n2i 

= — ==exp\ — ( r| 

s/2tt 1 24.9969 x 10 -2 

= 0.3988 

Therefore the standard deviation and mean value of the equivalent normal variable at P * 
from Eqs. (3.3.44a) and (3.3.44b) are 


Xl /*(*?) 

0.3982 

7.9944 x 10- 2 
= 4.9806 


, = ^[F^jx g)j) 

2 ) 

0.3988 
0.1596 
= 2.4984 
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— X 1 — ® 1 [-fxi( a: l)] or xi 

= 40 - 6.2258~ 2 x 4.9806 
= 39.6899 

/Xj;» = X 2 — $ [-fx2( a '2)] Cr *2 

= 50 - 2.4984 x 10 -2 x 2.4984 
= 49.9376 

(b) Set the mean value point as an initial design point and required /? convergence tolerance 
as £t = 0.001. Compute the limit state function value and gradients at the mean value point 


g(X*) = giflxn ^x 2 ) — 1400 

= 40 X 50 - 1400 
= 600.0 

P- 1, «*>., = M 

UX 1 

p-\, = /*., = « 

OX2 

(c) Compute the initial /? using the mean value method and its direction cosine a. 


A 


Pg 


«(*•> 
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600 


y (50 x 4.9806) 2 + (40 x 2.4984) 2 
= 2.1689 



= -0.3724 

(d) Compute a new design point X* from Eq. (3.3.28) 

= 39.6899 + 2.1689 x 4.9806 x (-0.9281) 
= 29.6645 

x 2 = (* X > 2 + /?ict x -q 2 

= 49.9376 + 2.1689 x 2.4984 x (-0.3724) 
= 47.9194 
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u, = 


1“/ M 




. X 2 -/X x - 


u, = 


& tL 


-2.0129 

-0.8078 


(3) Iteration 2: 

(a) Compute the mean values and standard deviations of the equivalent normal distributions 
for x* and x 2 : 

The density function values at x x and x 2 are 


1 r 1 Jnx l Mi/i x 2 i 

/«(*; = 2 ( — ; — " 

1 r 1 >29.6645 - 3.681 l , 2l 

= 7 ^ X 29.6645 X 0.12« CXPl “2 ( 0.1245 


= 7.0144 


-3 


/„(*;) 


sf2/Kx\a 


r 1 ( lnx 2 Pj /2 \ 2 l 
-exp[— -( ) J 


V2 


V2 


72^ x 47.9194 x 4.9969 x 10~ 2 
= 0.1185 


r 1 >47.9194 - 3.9108 x2l 
exp [--{ — : 777^ .. 77w7 ) J 


4.9969 x 10 


^-'[F^W)}) = 


1 r ^ / l nx \ Pyi \2i 

exp[--( 1 J 


\/2t 
1 


yi 


72^"" 2 
= 2.5909 -2 


r 1 >29.6645 - 3.681 l, 2l 
e x P[-7;{ n ) J 


0.1245 


1 r 1 , ItIX o Pyi \2l 

W'lF,,^)}) = -exp[--(— 2 —* -*■?] 


V2? 


'V2 
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1 r l./n47.9194 - 3.9108 x2l 

= — p= exp \ — ( VI 

y/2^ 1 2 V 4.9969 x 10~ 2 ’ J 

= 0.2837 


Therefore the standard deviation and mean value of the equivalent normal variable at P* 
from Eqs. (3.3.44a) and (3.3.44b) are 


2.5909 -2 

7.0144- 3 

= 3.6937 


* 2 fx a (*2) 

0.2837 

0.1185 

= 2.3945 


p x , = x;-*- 1 [f^(*;)K 

= 29.6645 - (-2.3384) x 3.6937 
= 38.3021 


2 ~ X 2 ^ [-^*2(^2 )] Cr ^i 

= 47.9194 - (-0.8256) x 2.3945 
= 49.8963 

(b) Compute the limit state function value and gradients at X * 
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g{X*) — 9 { x ii x 2 ) ~ x \ x 2 1400 
= 29.6645 x 47.9194 - 1400 
= 21.5041 

= *5 = 47.9194 
P~\ x . = x - = 29.6645 

OX 2 

(c) Compute the nonlinearity indices pi and P 2 based on the function values and gradients 
of the two points /z( 40,50) and **(29.6645, 47.9194) using Eqs. (2.4.10) and (2.4.11), that is 

asW = + eM‘ - (W'p. 

dx-i x\ OX 1 


50 = ( — — — ) Pl_1 47.9194 + e 2 (40 Pl - (47.9194* rHO^pi 

von C£/tc > v 


*^Pl unpi -1 ! 


‘29.6645 


dgiji) = + £2 (^ - {xlTWr'n 

dx 2 xX ox 2 


40 _ ( — — — ) P2_1 29.6645 + £ 2 (50 P2 - (47.9194* ) W )50 P2 x p 2 

V An m cia ' K 


•V'aV'MV* -1 ! 


47.9194 


m = ton + 1 - (*m + 5 * iw - w )") 1 


t=l 


29.6645 1 Pl , . APt on«c^e:PiV 

600 = 21.5041 + 47.9194 x (40 pl - 29.6645 Pl ) 

P i 

47 91 Q4 1_P2 

+29.6645 x (50 Pl - 47.9194 P2 

Pi 

+5^2 [W-KD’+W-Kn 1 ] 
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Based on the above three equations, p , and e 2 can be solved using the adaptive search 
procedure. 


Pi = 1.0375, p 2 = 1.4125, e 2 = 0.1 

(d) Construct the improved two-point adaptive nonlinear approximation (TANA2) using 
Eq. (2.4.9) 


g(X) = m + + 

1=1 UX ' P ' Z ,=1 

29 6645 1-10375 

= 21.5041 + 47.9194 x - ° (x}° 375 - 29.6645 10375 ) 

47 9194 1-1 - 4125 

+29.6645 x (xj' 4125 — 47.9194 1 ' 4125 ) 

1.4125 v 1 ’ 

+ ^1[( X 1.° 3 75 _ 29.6645 10375 ) 2 + (x 1-4125 - 47.9194 1-4125 ) 2 ] 

= 21.5041 + 40.6738(x 1 10375 - 29.6645 10375 ) + 4.2564(x 1-4125 - 47.9194 1-4125 ) 

+ ^1 [( x i.° 3 r 5 _ 29.6645 1 ' 0375 ) 2 + (x 1-4125 - 47.9194 1-4125 ) 2 ] 

(e) Transfer the above X-space approximate limit state function into the U-space function 
using Eq. (3.3.48) 


9{U) = 9{°x'U\ +P*;,<7*'«2 + Pr') 

= 21.5041 + 40.6738[(3.6937pi + 38.3021 ) 4 0375 - 29.66 45 1 0375 ] 
+4.2564[(2.3945/i 2 + 49.8963) 1-4125 - 47.91 94 1-4125 ] 

+^[((3.6937p! + 38.3021) 1-0375 - 29.6645 1-0375 ) 2 
+((2.3945p 2 + 49.89 63) 1,4125 - 47.9 194 1-4125 ) 2 ] 

(f) Find the most probable failure point X * of the approximate safety index model given in 
Eq. (3.3.46) using DOT 
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After two iterations, the MPP point is found as 


x\ = 29.3517, x\ = 47.6961 
u\ = -2.4236, u 2 = -0.9191 

At each iteration, the mean value and standard deviation of the equivalent normal 
distributions at the new design point X* need to be calculated. 

(g) Compute the safety index 02 


02 = \/uj 2 + 

= ^/(— 2.4236) 2 + (-0.9191) 2 

= 2.5920 

(h) Convergence check 

_ Ift-AI = 2-5920 -2.1689 = ^ 

e “ 0 l 2.1689 

Since £ > £ r (0.001), continue the process. 

(4) Iteration 3: 

(a) Compute the mean values and standard deviations of the equivalent normal distributions 
for x\ and x 2 : 

The density function values at x* and x 2 are 


/* i(*I) = 


\Z2TTX\Oy, 


1 Inx^ p yi ^2i 
-exp[— -( ) 1 


'yi 


1 


v/2^ x 29.3517 x 0.1245 
= 5.7886 x 10" 3 


r l/n29.3517 -3.681 1 2 , 
ex?I -2 ( 01245 > 1 


155 



fx 2 (^ 2 ) — 


1 


\/2jv: 


' KX 2 <J V2 


■exp[--{ 


1 . Inx2 p y2 


) 2 ] 


'V2 


1 


\/27r x 47.6961 x 4.9969 x 10" 2 
= 0.1097 


, l./n47.6961 — 3.9108 , 2l 
eX?l ~2 ( 4.9969 x 10~ 2 > 1 




1 . I lnx\ - p yi 2 

—==exp\--{ — — n 

^ 2^ Cy 1 ’ J 

1 . l./n29.3517 — 3.6811. 2l 

exp \ — ( ) 

nio/ic / J 


V2^ 

2.1156 -2 


0.1245 




1 


1 . Inx 2 Py2 


V 2 i 7 T O y 2 

1 , l./n47.6961 -3.9108 ... 

7^ ezpl ~2 ( 4.9969 x 10 -2 > 1 


= 0.2615 


Therefore the standard deviation and mean value of the equivalent normal variable at P * 
from Eqs. (3.3.44a) and (3.3.44b) are 


<7 


(*;)]) 

fxi( X l) 

2.1156" 2 

5.7886 -3 

3.6548 


fx 2 (^ 2 ) 

0. 261.5 
0.1097 
= 2.3833 
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fi x[ = xl-$ '[F^ix*)}?^ 

= 29.3517 - (-2.4236) x 3.6548 
= 38.2094 

/**j = *5 

= 47.6961 - (-0.9191) x 2.3833 
= 49.8865 

(b) Compute the limit state function value at X* 


g(X m ) = g{xlx* 2 ) = x* 1 x* 2 -im 

= 29.3517 x 47.6961 - 1400 
= -0.0359 

(c) Compute approximate gradients using the approximate limit state function 


-P-L = 47.8569 

dx^ 

P~\v = 28.5261 
<9x 2 

(d) Compute approximate safety index ji using the HL-RF method (Eq. 3.3.25) and the 
direction cosine a, 


/?3 — 


-0.0359 - 47.8569 x 3.6548 x -2.4236 - 28.5261 x 2.3833 x -0.9191 


^(47.8569 x 3.6548) 2 + (28.5261 x 2.3833) 2 


= 2.5917 
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(e) Approximate convergence check 


Since e < £ r (0.001), stop the process. The final safety index is 2.5917. 

3. 3. 3. 5 Algorithms Comparison 

In this section, several examples are used to compare the efficiency of the algorithms 
introduced in this chapter. These examples include problems with highly nonlinear, explicit 
and implicit performance functions which required finite element analyses. Furthermore, the 
summary of the safety index analysis is given. 

Example 3.10 

The performance function is given in Example 3.1. Two cases are considered in this example. 
In case 1, the mean values of x\ and Xi are 10 and 9.9, respectively, and the standard deviations 
of both variables are 5.0 (the same as in Example 3.3b). The mean and standard deviation of 
the case 2 are 10 and 5.0, respectively (the same as in Example 3.1). The comparison of the 
results obtained from the above four algorithms and the mean value method is shown in Table 
3.1. 

For case 1, the above algorithms 3 and 4 need only 3 g-function calculations and 2 gradient 
calculations to find the convergent solution, while the HL-RF method and algorithm 2 fail 
to the correct MPP on the limit state surface after 23 and 22 iterations, respectively, due to 
oscillation. Fig. 3.13 shows the MPP and how the algorithms 3 and 4 converge in three steps. 
HL-RF method approaches the limit state surface in the first few iterations, but after the fifth 
step, it completely diverges and oscillates away from the solution. For case 2, all the methods 
converge with a different number of iterations (Fig. 3.14). The algorithms 3 and 4 also need 
3 g-function calculations and 2 gradient calculations to find the convergent solution, while the 
HL-RF method and algorithm 2 need 7 iterations to converge. 
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Table 3.1 Comparison of Methods for Example 3.10 
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2.5n 



Fig. 3. 13 Iteration History of Example 3.10 (case 1) 



Fig.3.14 Iteration History of Example 3.10 (case 2) 
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Example 3.11 

This example is taken from the NESSUS manual [12]. The performance function is 

g{x 1 ,^ 2 ) = x\ + X 2 — 8.7577 

in which xi and x 2 are the random variables with normal distributions (mean=10, Cov— 0.3). 
The results comparison is listed in Table 3.2, which shows that the present method converges 
fast. Also, it shows the iteration history of the present method, and r is quite close to the 
nonlinearity of the real performance function. 

Example 3.12 

This example has a highly nonlinear performance function 

g{x i,x 2 ) = Xj + 2x* - 20 

in which xi and x 2 are the random variables with normal distributions (mean fi Xl = n X2 = 10-0, 
standard deviation a Xl = = 5.0). The comparison of safety index results is shown in Table 

3.3. In this example, the coefficient of coordinates shift s is selected as 1 and the nonlinearity 
index r is always equal to 4 in each step, this is the same as the nonlinearity of the performance 
function. The comparison results show that methods 3 and 4 are quite efficient in both X- 
space and U-space with only two iterations and an additional function calculation at the end 
of the iteration process. The HL-RF method and algorithm 2 did not converge even after 101 
iterations. These two methods started from the mean values and approached the constraint 
surface in the first few iterations, but after the fifth iteration, they completely diverged from the 
constraint surface. After several iterations they oscillated between /? = 0.9267 and /3 = 0.9862. 

Example 3.13 313-member frame 

This example has an implicit performance function needing finite element analysis. The 
frame structure shown in Fig. 2.3 has an I section modelled with 313 elements. Young’s 
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Table 3.2 Comparison of Methods for Example 3.11 


Method 

HL-RF 

Method 2 

Method 3 

Method 4 


1.6853 

1.6853 

1.6853 

1.6853 


2.5372 

2.5372 

3.1076 (2.0*) 

3.0588 (2.0, 1.0”) 


2.9521 

2.9521 

3.0584 

3.0588 




3.0588 (1.975*) 

— 

Iter. 4 

3.0583 

3.0583 

— 

— 

Iter. 5 

3.0585 

3.0585 

— 

— 

Final 

3.0585 

3.0585 

3.0588 

3.0588 

g-func. calculations. 

5 

5 

3 

3 

Gradients calculations 

5 

5 

3 

2 


1. The values with an asterisk (*) represent the nonlinearity index r for TANA. 

2. The values with an double asterisk (**) are the nonlinearity indices pi and p 2 fox TANA2. 


Table 3.3 Comparison of Methods for Example 3.12 


Method 

HL-RF 

Method 2 

Method 3 

Method 4 




0.6704 

0.6704 


1 


2.3655 (4.0*) 

2.3655(4.0,4.0”) 

1 

1 


2.3655 

2.3655 




— 

— 

Iter. 101 

■H 

0.9267 

— 



Final 0 

0.9267 

1.6016 

2.3655 

2.3655 

g-func. calculations. 

101(not conver.) 

101(not conver.) 

3 

3 

Gradients calculations 

101(not conver.) 

101(not conver.) 

2 

2 


1. The values with an asterisk (*) represent the nonlinearity index r for TANA. 

2. The values with an double asterisk (**) are the nonlinearity indices p 1 and p 2 for TANA2. 
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modulus E and the cross-sectional areas of all members are selected as the random variables 
with normal distributions, and the total number of random variables is 314. The area moment 
of inertia I z is expressed as explicit nonlinear functions of A in the form I z = 0.2072 A. The 
vertical loads at nodes 15, 16, 88, 89 are -26, -30, -18, -20 kips , respectively. The horizontal 
loads at nodes 6, 11, 17 through 65 by 3, 68 through 82 by 7, and 90 through 175 by 5 are 4 kips. 
The horizontal load at node 1 is 2 kips. After the first analysis, the most critical constraint 
of the total 358 displacement constraints for this load case, i.e. the vertical displacement d at 
point 16 is taken as the limit state function, which is an implicit function of random variables 

and is written a s 


g(X ) = 1. - d/d lim 

where d Hm is the displacement limit of 4.0 in. The mean value of Young’s modulus E is 2.9 x 10 7 
psi, with coefficient of variation (Cov) 0.08; all the element areas have a mean of 28.0 in 2 , with 
Con 0.08. The coefficient of coordinates shift s is selected as 1. The comparison of results 
presented in Table 3.4 shows that algorithm 3 in both X-space and U-space are very efficient 
for this complex implicit problem; only four iterations were needed to converge even though 
HL-RF method needed 45 iterations to converge to a local solution. The n g count in Table 3.4 
assumes finite difference calculation of gradients with respect to 314 random variables. 

3.4 Summary 

In this chapter, some basic concepts on the safety index and MPP calculations were 
introduced. The details of the Mean Value, HL, HL-RF and developed safety index algorithms 
using approximations were given. The numerical results showed that the mean value and 
HL/HL-RF method work well for the linear problems, however the HL/HL-RF may not converge 
even though many iterations are reached for highly nonlinear problems. The safety index 
algorithms using two-point adaptive nonlinear approximations are more efficient and stable 
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Table 3.4 Results Comparison for 313 Member Frame 


Method 

HL-RF 

Algorithm 3 

Algorithm 3 1 




U- Space 


X- Space 


Iter. No. 

0 

n, 

0 

r 

n. 

0 

r 

mm 

1 

1.0513 

■ 

1.0513 

- 

KB 

1.0513 

- 

KB 

2 

2.0343 


3.4146 

-2.5 

IS 

3.4147 

-2.5 

IS 

3 

2.9496 

315 

3.8542 


315 

3.8549 

-0.5 

315 

4 

3.7982 

315 

3.8521 

mwmi 

315 

3.8517 


315 

5 

4.5854 

315 







6 

5.3146 

315 







45 

12.540 

315 








14175 

1260 

1260 | 

Final Value 

0.000442 

0.000265 


0.000466 


of g-function 

Local Solution 

Converged 


Converged 



than HL/HL-RF for the highly nonlinear problems. In particular, the method with TANA2 
works the best compared to other methods in most cases. 

* 
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CHAPTER 4. FAILURE PROBABILITY CALCULATION 


4.1 Monte Carlo Simulation 

The Monte Carlo method was developed during World War II by Von Neumann and Ulam 
as a means of analyzing nuclear fission chain reactions. The application of the Monte Carlo 
method to probabilistic structural analysis problems is comparatively recent. This method 
became practical only with the advent of digital computers. It is a powerful mathematical 
tool for determining the approximate probability of a specific event that is the outcome of 
a series of stochastic processes. The Monte Carlo method consists of digital generation of 
random variables and functions, the statistical analysis of trial outputs, and variable reduction 

techniques. These are discussed briefly in this section. 

In this section, the general principle of the Monte Carlo Simulation is introduced first 
(Section 4.1.1); and two key techniques needed in using the Monte Carlo method, such as the 
generation of uniformly distributed random numbers, and the generation of random variables 
which are given in Section 4.1.2 and Section 4.1.3, respectively. The direct Monte Carlo and 
the modification of Monte Carlo (importance sampling) are introduced in Sections 4.1.4 and 

4.1.5, respectively. 

4.1.1 General Principle of the Monte C arlo Simulation 

As the name implies, Monte Carlo simulation techniques involve “sampling” at “random” 
to artificially simulate a large number of trials and observe the result. In the case of analysis 
for structural reliability, in the simplest approach, this means sampling each random variable 
Xt randomly gives a sample value x t . The limit state function g(X) = 0 is then checked. If the 
limit state function is violated, the structure or structural element has “failed”. The trial is 
repeated many times. In each trial, sample values are digitally generated and analyzed. If A 



trials are conducted, the probability of failure is given approximately by 


P 


rnjg < 0) 
N 


(4.1.1) 


where m is the number of trials for which g < 0 out of the N experiments conducted. 

In principle, the Monte Carlo simulation is only worth exploiting when the number of trials 
or simulations is less than the number of integration points required in numerical integration. 
This is achieved for higher dimensions by replacing the systematic selection of points by a 
“random” selection, under the assumption that the points selected will be in some way unbiased 
in their representation of the function being integrated. 


Example 4.1 


This example is taken from Ref. [1], Some leaks were detected on the weld seam between 
the tubes and the tubesheet of a horizontal heat exchanger. To analyze the leakage events 
or failure that occurred in the heat exchanger, the following probable reasons are considered: 
(A) There was a preexisting crack at the time of manufacturing and it was not detected; (B) 
the crack grew to a critical size when unsteady operation resulted in fatigue; and (C) stress 
corrosion cracking (SCC) occurred. The probability of the occurrence of events A, B and C 
is P(A)=0.2, P(B)=0.15, P(C)=0.4, respectively. Random numbers generated for use in this 
example only are listed as 0.1, 0.09, 0.73, 0.25, 0.33, 0.76, 0.52, 0.01, 0.35, 0.86, 0.34, 0.67, 0.35, 
0.48, 0.76, 0.80, 0.95, 0.90, 0.91, 0.17, 0.37, 0.54, 0.20, 0.48, 0.05, 0.64, 0.89, 0.47, etc. The 
probability of failure for the heat exchanger is estimated using the Monte Carlo method. 

To solve the failure probability Pj, first assume that (1) the event does not occur if the 
value of random numbers generated is greater than the probability of occurrence for the event, 
and is denoted by 0; (2) the event occurs if the value of random numbers generated is smaller 
than the probability of occurrence for the event, and is denoted by 1. The simulation procedure 
is shown in Table 4.1. The trial is repeated 50 times (N = 50) and 22 samples (m = 22) lead 
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to failure, so the failure probability can be computed approximately as 


Since the probability of occurrence for each event is known, the exact result can be directly 
obtained from the following calculations. 

(i) The probability that crack fatigue growth does not occur = 1-0.2 x 0.15 = 0.97 

(ii) The probability that SCC does not occur = 1-0.4 = 0.6 

(iii) The probability of failure = 1-0.97 x 0.6=0.418 

Therefore, the probability of failure estimated using the Monte Carlo simulation is 5.26% 
in error compared to the exact result of 0.418 

The simulation procedure illustrated in this example is the simplest Monte Carlo method for 
reliability problems; it may be the most widely used, but it is not the most efficient, especially 

for complex systems. 

4.1.2 Generation of Uniformly Distributed Random Numberg 

To use the Monte Carlo simulation to solve a practical problem, it is necessary to generate 
random numbers for different distributions. The random number of the [0,1] interval uniformly 
distributed is the simplest and most important random number. Based on this random number, 
the random number with arbitrary probability distributions can be obtained by means of various 
sampling techniques. Therefore, the [0,1] interval uniformly distributed random number is the 

basis for generating various distributed random numbers. 

Assuming that x is the random variable over the interval [0,1], its density function is given 

as 


/(*) 


1, 0 < x < 1 

0, otherwise 


(4.1.2) 
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Table 4.1. The Monte Carlo Simulation Procedure for Example 4.1 


Event occurrence 

Failure 


o 


o 


Leakage 

rH O 

o o 

© 

o o 


o 

o 

o 

H 

o 



H 

o 

H 

o 



o 

o 

© 

Random number 

o 

0.73 

o 

0.35 

0.67 


0.09 

0.33 

o 

© 

0.34 


0.1 

0.25 

0.52 

0.86 

Cause for leakage 


Crack fatigue growth 

see 

Crack fatigue growth 

see 

Crack fatigue growth 

sec 

Crack fatigue growth 

see 
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and its distribution function is given as 


F(x) = 


f 0, x < 0, 

x, 0 < x < 1 

1, x > 1 


(4.1.3) 


The sampling sequence fi, f 2 , over the uniformly distributed random variable x 


over the interval [0,1] is called the random number of the [0,1] interval uniformly distributed. 

There are many methods available for generating the random numbers. The most common 
practical approach is to employ a suitable “pseudo” random number generator (PRNG), 
available on virtually all computers of numbers. They are “pseudo” since they use a formula 
to generate a sequence of numbers. This sequence is reproducible and repeats normally after a 
long cycle interval. The following recurrence formula is usually used to generate the pseudo 
random number. 


Xh+\ = 7 Xn{mod M) 


(4.1.4a) 


a ^n+1 

rft+1 ~ ~W 


(4.1.46) 


where 7, M and x 0 are the preselected positive integers, which are determined by semi- 
theoretical and semi-experiential approaches. 

Eq. (4.1.4) means that x„+ 1 is the remainder of the product 7X ft dividing by Af, the value 
from xa +1 dividing by M is the (h + 1) uniformly distributed random number, f h+1 . Repeating 
the process, a sequence of random numbers can be obtained. 

For most practical purposes, a sequence of numbers generated by a suitable modern PRNG 
is indistinguishable from a sequence production of a reproducible sequence, which can be an 
advantage in certain problems. However, this reproducibility can be destroyed simply by 
(randomly) changing the “seed number” required for most PRNGs. A simple solution is to 
use the local time as a seed value. 
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4.1.3 Generation of Random Variables 


One of the key features in the Monte Carlo method is the generation of a series of values 
of one or more random variables with specified probability distributions. The most commonly- 
used generation method is the inverse transform” method. Let Fx ( x , ) be the cumulative 
function of random variable x t . By definition, the numerical value of Fx(xi ) is a value in 
the interval of [0,1]. Assuming that & is the generated uniformly distributed random number 
(0 < & < 1), the inverse transform method is used to equate the & to F x (x % ) as follows: 

F x (xi) = & or x i = Fx 1 Ui) (4.1.5) 

This method can be applied to variables for which a cumulative distribution function has 
been obtained from direct observation, or an analytic expression for the inverse cumulative 
function, i r_1 (.), exists. 

Example 4.2 

Generate random variables with type-I extreme value distribution. 

The probability density function of the type-I extreme value distribution is 

fx(x) = j-exp{—(^——^-) - exp [-(^— -)]} 
f'O to to 

The cumulative distribution function is 

F x (x) = exp[—exp(—^——^-j\ 

to 

where t 0 is a scale parameter and S is a location parameter. 

Let f be the random numbers from uniform distribution over the interval [0,1], and rj be 
the random variable with the specified distribution. Based on Eq. (4.1.5), 
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Fig. 4.1 Inverse transform method for generation of random variates 


Tj — 8 

F x (tj) = exp[-exp( — )] = f 

hence 

t i = 8 — t 0 ln(—ln £ ) 

The inverse transform technique is shown in Fig. 4.1. 

4.1.4 Direct, Sampling (Crude M onte Carlo) 

Eq. (4.1.1) gives the simplest Monte Carlo approach for reliability problems; it may be the 
most widely used, but it is not the most efficient, especially in complex systems. A commonly- 

used technique called crude Monte Carlo is introduced below. 

As defined in Eq. (3.1.3) in Section 3.1, the failure region is the event that the limit state 

g(X) < 0, and the failure probability 
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is rewritten as 


P f = P[g(X) < 0 ]=/-../ /*(X)dX 

•/ Jg(X)< 0 


(4.1.6a) 


Pf = /•••/ /[<?(*) < 0]/x(X)JX (4.1.66) 

where /[.] is an “indicator function” which equals 1 if [.] is “true” and 0 if [.] is “false”. 

In comparison with (B.2), it can be seen that the expectation of the indicator random 
variable for the failure event is just the probability that failure occurs. Hence 

P f = P[g(X ) < 0] = E[I(X)} = tn = nr, (4.1.7) 

and its variance is 

Var[I(X ) ] = E[I{Xf) - {E[I(X)]} 2 
= E[I(X)]-{E[I(X)}} 2 
= P[/(X)]{1-P[/(X)]} 

= Pfi 1 - Pf) (4.1.8) 

In order to evaluate Pj by the Monte Carlo method, a sample value for basic variable x t 
with a cumulative distribution F x (x,) must be drawn. The “inverse transform” method given 
in Section 4.1.3 can be used to obtain the random vaxiate, in which a uniformly distributed 
random number & (0 < & < 1) is generated and is equated to P x (x,), i.e., x t = 

Hence, independent random numbers £i ,6v,£n are drawn from the density f x (x t ) and the 
estimate of Pj is obtained: 

b = (4.1.9) 

n 1=1 
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where f)j represents the crude Monte Carlo estimator of ppj and fi is the number of the 
independent random numbers. 

The variance of the sample mean is computed as 


Var(P f ) = % = <£, 

So the sample variance is given as 


(4.1.10) 


n - l t=1 n i=1 


(4.1.11) 


Example 4.3 

This example is taken from Ref. [1]. The limit state function is given as 


g(X) = R - S = 0 

where P and S represent strength and stress, respectively. Both R and S are normally 
distributed with the following means and standard deviations: 


p R = 135MPa, a R = 15.0MPa, p s = lOOMPa, cr s = 12.0 MPa 

Estimate the failure probability using the crude Monde Carlo method. 

For convenience, only 14 variates R and another 14 variates S are given below, but generally 
more samples are needed. The procedure of the Monte Carlo simulation is shown in Table 4.2, 

where 

R = PR + 07 ?$ _1 (&) 

S = (is + vsQ-'iti) 

£ are the random numbers given in Example 4.1. In Table 4.2, only one of the sample pairs (P, 
S) led to a failure (i.e. P, < Si). 

The failure probability is 
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4 

Since both R and S are normally distributed, the exact result can be calculated as 

1 32 — 1 on 

Pf = $ (~ v / 15 2 + 122 ) = <>(-1-666) = 0.04746 
Obviously, more sampling is required. 

4.1.5 Variance Reduction - Importance Sampling 

Variance reduction techniques have a dual purpose: to reduce the length of a sample run 
and to increase accuracy using the same number of runs. 

In structural reliability analysis, where the probability of failure is generally relatively small, 
the direct (crude) Monte Carlo simulation procedure becomes inefficient. For example, in many 
pressure vessel technology problems, the probability of failure could be as small as 10 -5 or 
lO -10 ; this implies that nearly a million simulation repetitions are required to predict this 
behavior. If the limit state function g(X ) represents the mathematical model for structural 
simulation problems, the tail of the distribution of g(X ) is the most important factor. The 
simulated iteration must concentrate the sample points in this part in order to predict the risk 
reliably and to increase the efficiency of the simulation by expediting execution and minimizing 
computer storage requirements. Slow convergence is a severe penalty for the direct Monte 
Carlo method and has led to several variance reduction techniques. The importance sampling 
method, systematic sampling method, stratified sampling method, split sampling method, Latin 
hypercube sampling method, conditional expectation method, and antithetic variates method 
are some of the popular variance reduction techniques. Here, the importance sampling method 
is briefly introduced as an illustration to interpret the concept of variance reduction techniques. 

The importance sampling method is a modification of Monte Carlo simulation in which the 
simulation is biased for greater efficiency. In importance sampling, the sampling is done only 
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Table 4.2. The Monte Carlo Simulation Procedure for Example 4.3 
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in the tail of the distribution instead of spreading samples out evenly in order to ensure that 
simulated failure occurs. 

The failure probability of Eq. (4.1.6b) can be rewritten as 


P, = P\9(X) < 0] = J...J I[X VxW r x (X)iX (4.1.12) 

where fx(X) is the importance sampling probability density function. In comparison to Eq. 
(A.3.2), the expectation of the indicator function in Eq. (4.1.12) can be written in the form 


_ I(X)f x (X) 

P ' ~ e[ ^xT ] ^ 


(4.1,13) 


Let •••, in* denote random observations from the importance sampling function, /£(.). 

An unbiased estimate of Pf is given by 




1 ^ I(x*)f x (x*) 




£(*?) 


(4.1.14) 


The choice of /*(.) is quite important. If the density /*(.) has been chosen so that there 
is an abundance of observations for which I(x*) = 1 and if the ratio fx(x*)/f*(x*) does not 
change much with different values of x*, then Var[Pf] will be much less than Var[P f ] (Eq. 
4.1.10). Consequently, Pj requires many fewer observations than P } (Eq. 4.1.9) to achieve the 
same degree of precision. 

The variance of Pf is given by 


v ar { P;] = l { j...J l Mm mx)ix - lih) 


= Ir [ [1HM 
nV-y f;(x) 

The ideal choice of f*(x) is obtained using calculus. 


dx 


4 ,} 


d[^{P)] {Va r [Pf} + A t/ - / fx( x ) dx “ 1]} = 0 


(4.1.15) 


(4.1.16) 
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where A is a Lagrangian multiplier. This can be solved by using the calculus of variations. We 
obtain 


£(*) = 


\I{x)f x {x)\ 


/.../ \I(x)f x {x)\dx 
Substituting into Eq. (4.1.15), it is easily found that 


(4.1.17) 


Var[P ;] = \{\J - j I I{x)fx(x)\dx] 2 - n 2 P ,} (4.1.18) 

If |/(a:)/a : (^)| is positive everywhere, the multiple integral is identical with and 

Var[PJ] = 0. In this case the optimal function /*(.) is 

f:{x) = (4.1.19) 

HP } 

It can be seen that a good choice of £(.) can produce zero variance. Since p Pf is unknown, 
this is impossible. However, it demonstrates that if more effort is put into obtaining a close 
initial estimate of Pj, then the Var(P* } ) will be much less than the variance of Pj in Eq.(4.1.9). 
Conversely, the variance can actually be increased using a very poor choice of /*(.). Thus, the 
application of importance sampling is sometimes referred to as an art which must be used with 

caution. 


4.2 Response Surface Approximation 

The multi-dimensional integration of Eq. (4.1.6a) may be carried out analytically for 
a very limited number of cases. For most practical cases, the integration is impossible to 
conduct analytically. Numerical methods, such as the Monte Carlo simulation, can generally be 
performed to evaluate the integration, but it often turns out to be too computer time consuming. 
Thus, relatively simple and accurate approximate techniques to evaluate the reliability are 

needed. 
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Chapter 3 has introduced some approximate methods for the safety index calculations, 
which is the basis of the failure probability calculations given in this section. Even though the 
safety index can be used for the measure of the structural safety, we are still more interested 
in the reliability of structures, i.e., the failure probability. 

Since the n-dimensional probability density function can be given as a multiplication of 
n probability density functions for n random variables with standard normal distributions 
in the standard normal distribution space, most approximate methods for failure probability 
calculations are generated in the standard normal space so that the n-dimensional integration 
can be easily computed. Once the MPP U* is located using the safety index algorithms given in 
Chapter II, the approximate failure probability can be calculated by (i) approximating the limit 
state surface g(U) using an approximate surface at the MPP; and (ii) evaluating the failure 
probability defined by the approximating surface by exact or approximate means. 

Different approximate response surfaces result in different methods of the failure probability 
calculations. If the response surface is approached by a first-order approximation at the 
MPP, the method is called first-order reliability method (FORM); if the response surface is 
approached by a second-order approximation at the MPP, the method is called second-order 
reliability method (SORM). Furthermore, if the response surface is approached by a higher- 
order approximation at MPP, the method is called higher-order reliability method (HORM). 
Hence, the response surface approximations play an important role in the failure probability 
calculations. 

In this section, several different approximations which are used in FORM, SORM and 
HORM are introduced. Since the approximations are obtained in a new rotated space, the 
orthogonal transformation from U-space to the new space is introduced first in Section 4.2.1. 
The first-order and second-order Taylor approximations are given in Sections 4.2.2 and 4.2.3. 
The adaptive nonlinear approximation is introduced in Section 4.2.4. 


180 



4.2.1 Orthogonal Transformations 


In most failure probability calculations, the integration of Eq. (4.1.6a) is performed in the 
rotated new standard normal Y-space instead of U-space. In order to conduct the rotation from 
the standard normal U-space to the Y-space, an orthogonal matrix H needs to be generated, 
in which the nth row of H is the unit normal of the limit state function at the MPP, i.e., 
— VG({/*)/|VG(U*)|. To generate H , first, an initial matrix is selected as follows 


-dGjU^ldU i 

|VG(G*)I 

0 

0 


-aG(G*)/aG 2 

|VG(l/*)| 

1 

0 


-3G(C/*)/9G,, 

|VG(G*)| 

0 

0 


\ 


(4.2.1) 


VO o ... 1 / 

where the last n - 1 rows consist of zeros and unity on the diagonal. The Gram-Schmidt 
algorithm [2] is used to orthogonalize the above matrix to obtain an orthogonal matrix. First, 
let /i, / 2 , ..., f n denote the first, second, ..., nth row vector of the above matrix, respectively; 

i.e., 


f -dG(U*)/dU\ -d GJJJ^ydU2 — dG(t/*)/dG n 

^ ' |VG(t/*)| |VG(t/*)| |VG(£/*)| 


/ 2 = {o, i, o, ..., 0} T 


fn = {0,0,0, ..., 1} T 

1 

611 = D[ 

7i = e n/i 


181 



and, in general, 


^2 = [(/2,/ 2 )-|(/ 2 ,7l)| 2 ] 

. (/ 2,7i) 

12 D 2 


1 

2 



72 — e 127l + e 22l2 


Dk — [( fk,fk ) |(/a,7i)| 2 — |(/fc,72)| 2 — , ... , — |(/*,7fc-i)| 2 ] 


1 

2 


Z\k 


e 2 fc 


(/*»7i) 

D k 

(fk, 72) 

D k 


Cfc-l.Jt = 


_ (/*,7fc-i) 


D t 


Gkk D k 

7 k = c i*7i + e 2 <;72+, ..., e*_ lt *7fc_i + e^7t 


where (/,/) and (/, -y) represent the scalar product (dot product) of two vectors. It can be 
verified that the generated vectors 71, 72> •••■> 7n ^-re orthogonalized. The generated orthogonal 
matrix Hq is 


( Ti T \ 



(4.2.2) 


\iJ) 

In fact, in the orthogonal matrix of Eq. (4.2.2), the first row is -VG{U*)/\VG{U*)\ due 
to D\ 1. To satisfy that the nth row of H is — VG(f/*)/|VG(£/*)|, the first row of the 
orthogonal matrix is moved to the last row. This rearranged matrix is also an orthogonalized 
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Fig. 42 First-order approximation of the response surface in Y-space 


matrix and satisfies that the nth row of H equals -VG(l/*)/|VG(tf*)|, so it is defined as H 
matrix and is given as 



H = 



(4.2.3) 


4.2.2 First-order Approximation of R esponse Surfaces 

Assuming the most probable failure point (MPP) in U-space as U* = ...,u n } T , the 

linear approximation of the response surface g(U) = 0 is given by the first-order Taylor series 
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expansion at the MPP, 


g(U) « g(U*) + Vg(U*)(U -U*) = 0 (4.2.4) 

In this equation, g(U m ) equals 0 because U* is on the response surface. Divided by |V< 7 ({/*)|, 
Eq. (4.2.4) is rewritten as 


m 


From Eq. (3.3.25), we have 


W) 

IW)I 


(U - IT) 


Vg(U*)U* 


= -P 


\Vg{U*)\ 

Substituting this equation into Eq. (4.2.5), we obtain 


(4.2.5) 


(4.2.6) 


ma w^m \ u+l3=0 (4 - 2 - 7) 

By a rotation of U into a new set of mutually independent standard normal random variables 
Y using the orthogonal matrix H given in Eq. (4.2.3), 

Y = HU (4.2.8) 

and the approximate response surface given in Eq. (4.2.7) becomes 


g(U) « —y n + = 0 (4.2.9a) 

or 

Vn = P (4.2.9 b) 

Eq. (4.2.9b) is the first-order approximation of the response surface in the rotated standard 
normal space (denoted as Y-space), as shown in Figure 4.2. If the limit state functions of the 
practical problems are linear or close to linear, this approximation closely or exactly represents 
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the response surface. Otherwise, the truncation errors from the first-order Taylor approximation 
might be large and more accurate approximations would be needed. 

4.2.3 Second-order Approximation of Response Surfaces 

The second-order approximation of the response surface g{U) = 0 is given by the second- 
order Taylor series expansion at the MPP, 


gib I) « g(U-) + Vg(V)(V - V) + \ (V - U-) T V 2 g(U-)(U - V) (4.2.10) 

where V 2 0(£/*) represents the symmetric matrix of the second derivatives of the failure function. 


V 2 g(ir) tJ 


duiduj 


Dividing by \Vg(V)\ and considering s(£/*)=0, we obtain 


(4.2.11) 


where 


and 


g(U) w a T (U -U")+ l -(U~ U') t B(U - U") 


|V S ((/*)| 


n vwn 

|V S (t/-)| 


(4.2.12a) 

(4.2.126) 


(4.2.12c) 


Physically, the following transformations are the coordinate rotations to make the y n axis 
coincide with the /3 vector, as shown in Figure 4.3. Substituting Eq. (4.2.8) into Eq. (4.2.12) 
and replacing the first term by Eq.(4.2.9a), the U-space approximate response surface is rotated 

as 


g(Y) * -y n + D + - B-'Y-f B(H-'Y - H~'Y >) (4.2.13) 
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Fig. 43 Second— order approximation of the response surface in Y-space 


where Y m is the Y-space MPP (Y* = {0, 0, fi} T ) corresponding to the U-space MPP U* . In 
Y-space, y n axis is in coincidence with the /? vector. 

Since the H matrix is an orthogonal matrix, 

H- 1 = H T (4.2.14) 

Substituting this equation into Eq. (4.2.13), we have 

9{Y) « ~Vn + 0 + \{Y - Y*) t HBH t (Y - Y m ) (4.2.15) 

where 

= (4.2.16) 
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By a series of orthogonal transformations, Hi, H 2 , ••• H m , for the first n 1 variables 

Y = {yi,y2,-,yn-i} r ) *-e-, 




(4.2.17) 


Quantities associated with n - 1 variables are denoted with a bar. Finally, the first (n 1) x 
(n - 1) order matrix of HBH T will become a diagonal matrix 


/ « i 0 


HBH t = 


0 *2 
0 0 


0 ^ 
0 

0 


\ 0 0 ... ICn-l / 


and Eq. (4.2.15) becomes 


(4.2.18) 


Vn 



(4.2.19) 


In fact, the above procedure of finding the diagonal matrix can be treated as an eigenvalue 
problem. So i* are the eigenvalues of matrix HBH T whose elements are given by 


K i: = {HBH T ) h , i,j — 1,2, ...,n — 1 (4.2.20) 

where /c t j represents the curvature of the response surface at the MPP. 

Eq. (4.2.19) is the second-order approximation of the response surface in the rotated 
standard normal space. The major computational cost is in computing the second derivatives B 
of the limit state function at MPP. The exact second-order derivatives of g{U ) require additional 
n(n + l)/2 function calls for a finite difference scheme. For problems having a large number 
of random variables, this calculation is extremely computer intensive. From this procedure, 
it is clear that one has to increase the computational efficiency in calculating the curvature 
matrix and second-order function derivatives. Then it enables an accelerated and cost-effective 
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Fig- 4-4 Fitting of paraboloid in Y— space 


procedure to perform the second-order probability analysis, particularly when finite-element- 
based structural analysis tools are used. In the next section, two second-order approximations, 
which were presented by Wang and Grandhi [3] and by Der Kiureghian, et al [4], with no 
computational cost of the second-order derivatives calculations are introduced. 

4.2.4 Second-order App roximation of Response Surfaces with Approximate Curvature 

In Ref. [3], the second-order derivatives of the limit state function are approximately 
calculated by using an approximate performance function. This approximate performance 
function was constructed during the safety index search process, which is given in Eq. (3.3.74). 
The approximate second- derivatives are given as 
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= 


d 2 g(U*) 


duiduj 

= (r-l) ±(u,„ + W)» 


= 0 , i ± j 


(4.2.21) 


By considering Eq. (4.2.12c) and the orthogonal transformation of Eq. (4.2.8), the curvature 
K . can be approximately determined from Eq. (4.2.20). Since the nonlinear function given in 
Eq. (3.3.52) is fairly accurate around the MPP when convergence is realized, the calculation of 
second-order derivatives using this nonlinear approximation would give improved accuracy in 
failure probability compared to the first-order methods. Also, this procedure avoids the exact 
second-order derivatives computations of the limit state function at the MPP. 

In Ref. [4], the approximating paraboloid is defined by fitting a set of discrete points selected 
on the limit state surface at prescribed distances from the MPP. These fitting points, 2(n - 1) 
in number, are selected along the coordinate axes in the rotated space in the manner described 
in Figure 4.4. Along each axis y u i = 1, 2, ..., n - 1, two points axe selected with the coordinates 
(_ k/3,ri-i ) and (k/3,r)+i), where the subscripts —i and +i refer to the negative and positive 
directions on the jr t axis, respectively, and k is a preselected coefficient. The ordinates t?±« are 
obtained as solutions of y n in g(Y) = 0 with Y = (0,...,±*/?,0,...,y„). A simple algorithm for 

finding these solutions is described in the Appendix C. 

This method is expected to provide computational savings when the number of variables 
is very large. In fact, if finding the ordinates r? ± , needs m iterations, this procedure requires 
2 x n x m exact g-function calculations. If n is large and m is about 10 to 20, then this 
procedure may not be efficient even though it might take less computational time than the 
original second-order approximation. An advantage of this method is that it can be used for 
problems with an inflection point at Y* since two semiparabolas are used. 

In all the mentioned second-order approximations, if the limit state functions of the practical 
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problems are quadratic, linear, or close to quadratic or linear, the approximation would fit the 
response surface well. However, in some cases, the limit state functions may be highly nonlinear 
or have an inflection point at the MPP (see Figure 4.5 in the next section). For these cases, the 
second-order approximation might result in larger errors. Hence, a more accurate and adaptive 
approximation is given in the next section, which was presented by Wang and Grandhi in [ 5 ]. 

4.2.5 Higher-order approximation of response surfaces 

As discussed in the previous section, in some cases, the second-order approximation can 
not yield a good representation for the response surface because the curvatures at the MPP 
do not provide a realistic picture of the surface in the neighborhood of the MPP. For example, 
when the MPP is an inflection point, as shown in Figure 4.5a or when the limit state surface 
is highly nonlinear, as shown in Figure 4.5b, the curvatures are zero and the second-order 
approximate surface reduces to the tangent plane, thus, providing no improvement over the 
first-order approximation. 

In order to obtain the higher-order approximation of the response surface, first, we need to 
rotate the standard normal U-space to the rotated standard normal Y-space. The procedure 
of the rotation transformation is given in Eq. (4.2.8). In Y-space, the random variables Y 
are also independent, standard and normally distributed. The y n axis is in coincidence with 
the (3 vector. In order to obtain a more accurate approximation in Y-space, an adaptive 
nonlinear function is constructed based on two points selected on the limit state surface with 
the coordinates (—k/3, — k/3, ...., 7 ? a ), and (k/3, k/3, ...., 775 ), where r) a and 774 are the y n values 
corresponding to the negative and positive directions of the y, (i = 1 , 2 , ...,n — 1 ), respectively. 
A: is a preselected coefficient which can be selected from 0.1 to 1.0. In this work, k is selected as 
0.1. The ordinates r) a and 774 are obtained as the solutions of y n in g(Y) = 0 with Y a = (—k/3, 
—k/3,... —k/3, 77 a ), and I 4 = (k/3, k/3,... k/3 , 774 ). A simple algorithm for finding Tj a and 774 is 
given in Appendix C. Unlike in Ref. [4], the iterations for finding the coordinates r} a and 774 are 
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Exact Surface 
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Fig. 4.5 Higher-order and other approximations for the response surface 


performed on the approximate performance function instead of the exact analyses, which was 
constructed for computing the safety index 0. This nonlinear approximation is fairly accurate 
in the neighborhood of the MPP when the convergence for 0 is realized. These approximations 
provide tremendous computational savings when the finite element methods are used for the 
analyses. 

Based on these two points selected on the limit state surface, a two-point adaptive nonlinear 
approximation is established. The approximation is similar to the one used in finding the MPP 
in Ref. [6] but the nonlinear index is an integer instead of a real number. The errors from the 
integer index are eliminated by adding the weight coefficients to each term of the approximation. 
The approximation is required to pass through two base points and the MPP. The details of the 
approximation based on Y a and Yi are given as follows. The intervening variables are defined 
as 


Si = y? i = 1,2, ...,n — 1 (4.2.22) 

where m is the nonlinearity index, which can be a positive or negative. Since the random 
variables y { (i = 1,2, ...,n - 1) vary from -oo to +oo in Y-space, the nonlinearity index m is 
defined as an integer to avoid numerical problems in Eq. (4.2.22) when j/ t is negative with a 
real index. The approximate function y n is obtained by expanding the function in terms of the 
intervening variables given in Eq. (4.2.22) at Y a = (-k0,-k0, ...~k0). The weight coefficients 
are added to each term of the approximation to improve the accuracy since the nonlinearity 
index is an integer. The approximation is written as 


my) = i my .) + 1 ’£ t - vz) 




(4.2.23a) 

where y n (Y) and y n (Y) represent the approximate and exact functions, respectively, and 
can be computed by the differential method of implicit functions as 
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where Y — {j/i, 2 / 2 , 


dyJXa) = dg{Y a ) dg(Y a ) (4.2.236) 

<9y t dy, dy„ 

y n _ 1 } T and y = {j/i,J/ 2 ,— ,J/n} T - The function value at the MPP, i.e. 


Y*(0,0, ...,/?), is 


n — 1 


P = yn{Y a ) + - E ^ 

171 t= 1 


1-m 


dynQ^a) / m \ 

% ^ ^ 


By substituting Eq. (4.2.24) into Eq. (4.2.23a), the approximation becomes 


(4.2.24) 


yn(T) = P + — E fl... ^ 


(4.2.25) 

= P + m ^ v 

Eq. (4.2.25) has n unknown constants, m and U (i = l,2,...,n- 1). They can be evaluated 
by using the following n equations, that is, by letting the approximate function value and the 
derivatives at Y b equal their corresponding exact values at this point, 


dyn( y fe) _ t sKaj 1 m ^VniYa) * = 1, 2, ..., n - 1 (4.2.26a) 

dyi ’ Vi,b dm 


y n (Yb) = P + 


1 


m 


V' t 1 -m ^ynjYg) m 
E t'Vi* Qy { y '’ b 


(4.2.266) 


where U (i = 1,2 , ...,n - 1) is a real number, which gives additional degrees of freedom for 
improving the approximation accuracy since the nonlinear index, m, is an integer. If they are 
equal to 1, Eq. (4.2.23) is a Taylor series expansion. Eq. (4.2.26) has n unknown constants, and 
they can be determined by using a simple adaptive search technique given in Section 3.3.3.6. 
The approximate function values at Y a , Y b and MPP, and derivatives at Y b are equal to their 
respective exact values. The function is a paraboloid approximation when m is equal to 2. The 
approximate function can be used for the problems shown in Figs. 4.5a and 4.5b where the 
paraboloid approximations can’t provide any improvement over the FORM. This approximation 
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is simple to implement with less computation even when the number of variables is large and 
can also be used for highly nonlinear problems. 

The approximation given in Eq. (4.2.25) is rewritten as 


where 


n— 1 


MY) = 0+H “‘VT 
1 = 1 

(4.2.27a) 

_ _ , yl~a m dy n (Y a ) 

a t — tj Q 

m dyi 

(4.2.276) 


4.3 First Order Reliability Method (FORM) 


After approximating the response surface, the failure probability can be calculated by 
integrating Eq.(4.1.6a). In the first order reliability method, the limit state surface is 
approximated by the tangent plane at the MPP given in Eq. (4.2.9). Therefore, the approximate 
failure region Cl is defined as 


Cl = {Y\y n -/3> 0} (4.3.1) 

Since the random variables in Y-space are independent, standard and normally distributed, the 
n-dimensional standardized normal probability density function can be written as 


V2i •■■■> Dn ) 


+ y\ + ... + y 2 n )] 

<l>{y\)<t>(y2)-<i>{yn) 


(4.3.2) 


where <f>(yi) is the probability density function for the ith random variable with a standard 
normal distribution. 

The failure probability given in Eq. (4.1.6a) can be computed from a formulation in Y-space. 
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/ oo t oo r ^ 

... / <Ks/i)-<K2/n-i) / <f>{yn)dy n dyn-i-dyi 

-oo J-00 JP 


rco roo 

= 1 - / ... / ^(yi)--W»-l) 

r-t 

7 

e 

^ 

(4.3.3) 

J —CO J—oo 

j —00 


Because 

rP 

/ <f>{y n )dy n 

J—oo 

= *W 

(4.3.4) 

and 

f+oo 

/ 4>{yi)dyi = 1 , 

i = 1,2, ...,n — 1 

(4.3.5) 


Substituting these two equations into Eq. (4.3.3), we obtain 


P f = 1 — * 00 ) = *(-j0) ( 4 - 3 - 6 ) 

Eq. (4.3.6) provides the exact estimate of the probability of failure if the limit state function 
is linear and the random variables are normal distributions. Since the approximation to the 
response surface is the first-order Taylor approximation, the method is called the first-order 
reliability method (FORM). FORM usually works well when the limit-state surface has only one 
minimal distance point and the function is nearly linear in the neighborhood of the design point. 
However, if the failure surface has large curvatures (high nonlinearity), the failure probability 
estimated using the safety index 0 by FORM may give unreasonable and inaccurate results [7] 
and more accurate approximate methods have to be applied. 

Example 4.5 

This example was given in Example 3.12 of Chapter 2. The performance function is 

g(x i, £ 2 ) = x\ + — 20 

where x x and x 2 are the random variables with normal distribution (mean x 1 = x 2 = 10.0, 
standard deviation a x = *2 = 5.0). The safety index 0 was obtained from Example 3.12, i.e. 
0 = 2.3654. Using Eq. (4.3.6) (FORM), the failure probability is computed as 
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Pf = $(-/?) = $(-2.3654) = 0.009 


The failure probability using the Monte Carlo method (sample size=100,000, seed=5000) 
is 0.001950. Compared with this result, the first-order reliability method is inaccurate for this 
highly nonlinear problem. Therefore, more accurate approximate methods are needed. 

4.4 Second Order Reliability Method (SORM) 

As mentioned in the previous section, if the failure surface has large curvatures, i.e., high 
nonlinearity, the failure probability estimated using the safety index /? by FORM may give 
unreasonable and inaccurate results (Figure 4.6) [7]. For the linear limit state bb, containing 
Pi as design point, the failure probability for normal variables is given exactly by Pj = $(-/?). 
However, the point Pi is also the design point for nonlinear limit state functions aa and cc. 
In terms of first-order reliability theory, each of these limit states has an identical value of /?, 
and hence an identical nominal failure probability Pj — $( — 3')i however it is quite clear from 
Figure 4.6 that the actual probability contents of the respective failure regions are not identical. 
Similarly, the limit state dd represents probably a lower failure probability still; yet its safety 
margin Si is less than 3 . Evidently 3 defined so far lacks a sense of u coniparat i veness " or an 
ordering property” with respect to the implied probability content for nonlinear limit states. 

A further point of interest is that no limitation has been placed on the direction of 3 in 
U-space so that, for some other checking point P 2 , the probability content for the linear limit 
state ee should be identical with that implied by bb when both have the same distance 3 from 
the origin. 

In the above cases, more accurate approximate methods have to be applied. Breitung 
[8], Tvedt [9][10], Hohenbichler and Rackwitz [11], Koyluoglu and Nielsen [12], and Cai and 
Elishakoff [13] have developed second-order reliability methods (SORM) using the second-order 
approximation given in Eq. (4.2.19) to replace the original failure surfaces. Wang and Grandhi 
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Fig. 4.6 Inconsistency between 0 and for different forms of limit state functions 


[3] and Der Kiureghian, et al [4] calculated second-order failure probabilities using approximate 
curvatures to avoid exact second-order derivatives calculations of the limit state surface. 

Breitung’s and Tvedt’s formulations are introduced in Sections 4.4.1 and 4.4.2, respectively. 
Wang and Grandhi’s SORM with approximate curvatures calculations is given in Section 4.4.3. 

4.4.1 Breitling’s Formulation 

To explain the Breitung formulation, first, a Laplace method for the asymptotic 
approximation of multidimensional integrals is needed. Defining 

/(/?)= / esp( ~^ — )dY ( 4 - 3 - 7 ) 

v -W)<o 1 
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where 1(0) is an integral over a fixed domain whose integrand is an exponential function 
depending linearly on the parameter 0 2 . An extensive study of the asymptotic behavior for 0 2 
is described in Ref.[14], Chapt. 8. Using the results given there, the asymptotic form of 1(0) 
is (details see Appendix D) 

m ~ _ oo (4.3.8) 

where J is a quantity independent of 0 depending only on the first and second derivatives of 
the failure surface at the MPP, which is defined in Eq. (D.3) in Appendix D. 

In the case of independent standard normal random variables, the joint probability density 
function (PDF) is given by Eq. (4.3.2), i.e., 

P, = exp(-Vl)iU (4.3.9) 

Substituting (x 1 ,x 2 ,...,x n ) (y u y 2 , ...,y„) with y { = 0~ 1 u i : 

P, = J^exp(-P^)dY (4.3.10) 

Substituting Eq. (4.3.8) into this equation, we obtain 

P f ~ (2n)- 1/2 0- 1 exp(-~)\J\~ 1/2 , 0^oo (4.3.11) 

Since the failure surface is approximated by the quadratic Taylor series expansion at the 
MPP given in Eq. (4.2.12), | J\ can be computed based on Eq. (D.9) given in Appendix D, 

kl = Z)l^l =tn( 1 + ' c ui 9 ) (4.3.12) 

«=i t=i j=i 

where p is the number of points on g(U) = 0 with the shortest distance 0 from the origin to 
the failure surface, and is the main curvature of the failure surface at the MPP. If there is 
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only one MPP on the surface, by substituting this equation into Eq. (4.3.11) and considering 
Mill’s ratio 


$(-y) ~ (27r)- 1/2 y- 1 exp(-y 2 /2) (4.3.13) 

Pj can be computed 

p,««(Vria + ^)- 1/2 (4 - 3 - 14) 

j=l 

Since Eq. (4.3.14)is an analytical equation, it is easy to implement the Breitung algorithm. 
The main steps of Breitung’s formulation include: 

1) . Conducting the safety index search and locating the MPP, U ; 

2) . Computing the second-order derivatives of the limit state surface at U* and forming the 
B matrix given in Eq. (4.2.12c); 

3) . Calculating the orthogonal matrix H based on the procedure given in Section 4.2.1, 

4) . Computing the main curvatures Kj of the failure surface at the MPP using Eq. (4.2.20), 

5) . Computing the failure probability Pf using Eq. (4.3.14). 

Example 4.6 

Compute the failure probability P, using the Breitung method (Eq. 4.3.14) for Example 
4.5. 

1) . Compute the safety index and MPP, U*\ 

The safety index /? was calculated as /? = 2.3654 from Example 3.12. The MPP was located 

at £/*(_l.6368, —1.7077) (in X-space, X*(1.8162, 1.4613)). 

2) . Compute the second-order derivatives of the limit state surface at U* and form the B 

matrix given in Eq. (4.2.12c); 

= = 4*?<n = 4 x 1.8162 3 x 5 = 119.8148 

du 1 dx ! 1 

— 4x202 = 8 x 1.4613 3 x 5 = 124.8218 

du2 dx2 
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pfl 

0^ = 12xl = 12 x 1.8162 2 = 39.583 


d 2 g_ 
dx\ 


= 24 x\ = 24 x 1.4613 2 = 51.2495 


d 2 g d 2 g , , 

0 ^ = -^(y\ = 39.583 x 5 2 = 989.5592 

d 2 g d 2 g , „ 

du 2 = Ih?* 2 = 5L2495 x 5 = 1 281. 2632 


^•>1 = 

= v^m.SMS) 2 + (124.8218) 2 
= 173.0205 


= YMn 

IW)I 

1 ( 989.5592 0 \ 

\Vg(U*)\ y o 1281.2632 / 

3). Calculate the orthogonal matrix H based on the procedure given in Section 4.2.1; 


H f 72 *) f~°- 7214 06925 ^ 

\7i r / \ -0.6924 -0.7214/ 

4). Compute the main curvatures k } by solving the eigenvalues of HBH T ; 


HBH t 


/ 6.5278 -0.8423 

\ -0.8423 6.5968 


An eigenvalue of the above matrix is solved as k x = 6.5278, so the main curvature of the 


failure surface at the MPP is 6.5278. 

5). Compute the failure probability Pj using the Breitung formula 
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Pf = $(-/?> no - +«^)" i/2 

j=i 

= $(— 2.3654)(1 + 6.5278 x 2.3654) _1/2 
= 9.0040 x 10 -3 x 0.2466 
= 0.00222059 

Compared with the FORM’S result (P f = 0.009004), Breitung’s method is closer to the 
Monte Carlo result (Pj = 0.001950). It generally provides better results than FORM due to 
the second-order approximation. However, this method is not valid for pKj < -1 and does not 
work well in the case of negative curvatures. 

4.4.2 Tvedt.’s Formulation 

Based on the second-order approximation of the failure surface given in Eq. (4.2.19), the 
approximate failure region Cl is defined as 

n = {r|ji» -(0 + zIl w?) > °) < 4 ' 3 ' 15) 

Z ;=1 

The failure probability given in Eq. (4.1.6a) can be computed from a formulation in Y-space. 


Pf = 1 - f ... [ <j>(yi)..4(yn~i) J ^ /2 <j>{y n )dy n dy n -i—dyi (4.3.16) 

7-00 7-00 J P+2 2-J * iy i 

1=1 

Tvedt has derived a three-term approximation to this equation by a power senes expansion 

in terms of *„?, ignoring terms of order higher then two. The resultant approximation 
1 i = 1 


for Pf is 


71— 1 


At =$(-/!) ]J(1 + 


.W/2 


(4.3.17a) 


1=1 


a 2 = [/?$(— jd) - m\ ■ inV + 0*r 1/J - "riV + a * + (4 ' 3 ' m) 

i=l 1=1 
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^3 = (/? + 1 )\m-P) - 4>m ■ {fid + ^,')' 1/2 - ^e{JJ(l + {0 + 1 )«,-)- 1/2 } (4.3.17c) 

t=l t= 1 

Pi = A l + A 2 + ^3 (4.3.17 d) 

The first term, A i is the Breitung formula of Eq. (4.3.14). J?e[.] denotes the real part. 
This method has been found to give very good approximations in most cases. The asymptotic 
behavior of the three terms can be compared in the asymptotic sense used in Eq. (4.3.14). It 
may be shown that the ratio of the second term to the first term is 


A 2 _ 1 ^ 0Kj 

M ~ 1 — /V 

Similarly, the ratio of the third to the first term is 


0 


oo 


(4.3.18) 


n— 1 


1 ~ 
upfri-w a/* js.ir + i(i-/s«i)(i -/>*.)’ p 


oo (4.3.19) 


Since Eq. (4.3.19) is an analytical equation, it is easy to implement the algorithm. The 


main steps of the Tvedt’s formulation are the same as Breitung’s except step (5), i.e., the 
failure probability Pj is calculated using Eq. (4.3.17). 


Example 4.7 


Compute the failure probability P } using the Tvedt method (Eq. 4.3.17) for Example 4.5. 
The first four steps are the same as Example 4.6, i.e., 

1) . Compute the safety index and MPP, U*; 

The safety index 0 was calculated as 0 = 2.3654 from Example 3.12. The MPP was located 
at <7*(-1.6368, -1.7077) (in X-space, **(1.8162, 1.4613)). 

2) . Compute the second-order derivatives of the limit state surface at U* and form the B 
matrix given in Eq. (4.2.12c); 


dg 

du\ 


dg_ 

dxi 


<7i = 4x?<ri = 4 x 1.8162 3 x 5 = 119.8148 
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= 4x 3 2 <t 2 = 8 x 1.4613 3 X 5 = 124.8218 

du 2 dx 2 

= 12xl = 12 x 1.8162 2 = 39.583 
dx\ 1 

d 2± = 24xo = 24 x 1.4613 2 = 51.2495 
dx\ 2 

= ^^2 = 39.583 x 5 2 = 989.5592 
du\ dx\ 1 

= = 51.2495 x 5 2 = 1281.2632 

dul 5x1 2 


|V*(tni 


l(^L) 2 + (^-7 

/W + W 

/(119.8148) 2 +(124.8218) 2 


7Q none; 


V 2 5 (C/*) 

B ■ |Vflr(tf*)l 

! / 989.5592 0 \ 

|Vflr(«/*)| \ 0 1281.2632 / 

3). Calculate the orthogonal matrix H based on the procedure given in Section 4.2.1; 


/ -0.7214 0.6925 \ 

\ -0.6924 -0.7214 ) 

4). Compute the main curvatures Kj by solving the eigenvalues of HBH , 



HBH t 


( 6.5278 -0.8423 

\ -0.8423 6.5968 


An eigenvalue of the above matrix is solved as * = 6.5278, so the main curvature of the 
failure surface at the MPP is 6.5278. 

5). Compute the failure probability P f using the Tvedt formula (Eq. 4.3.17) 
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The first term of the Tvedt formula is the same as Breitung’s method, so 


A x = 0.00222059 


a 2 = \p*(-p) - <£(£)] • { n (i + ^« t )~ i/2 - n (i + (^ + i)«.) _i/2 } 

*=i »=i 

= [2.3654 x $(-2.3654) - <£(2.3654)] 

•{(1 4- 2.3654 x 6.5278) -1 / 2 - (1 + (2.3654 + 1) x 6.5278)- 1 / 2 } 
= 2.2205 x 10" 3 


^3 


n-1 


71—1 


o» + 1) - mi • { n (i + « _1/2 - «=[ii(i + (<» + 1)«, ■)-■'*)} 

t = l 

(2.3654 + 1) [2.3654 x $(-2.3654) - <£(2.3654)] 


t=l 


•{(1 + 2.3654 x 6.5278)" 1/2 - Re[( 1 + (2.3654 + 1) x 6.5278)- 1/2 ]} 
-1.3297 x 10' 4 


Pf = Ax + A 2 + A 3 = 0.00222059 + 2.2205 x 10 -3 - 1.3297 x 10" 4 = 0.002087 

Compared to the FORM result (Pj = 0.009004) and the Breitung result (P f = 0.00222059), 
Tvedt ’s method is closer to the Monte Carlo (P f = 0.001950). 

Like Breitung’s algorithm, Tvedt’s method is also invalid for j < — 1 and does not work 
well in the case of negative curvatures. 

4.4.3 SORM with Approximate Curvatures 

In this method, Breitung’s and Tvedt’s formulas are used to perform the failure probability 
calculations. However, the main curvatures are approximately calculated by using the nonlinear 
approximation constructed during the safety index search of this work. 
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The main steps of the SORM having approximate curvatures are summarized as follows for 

a complete failure probability analysis. 

1) . Conducting the safety index search and locating the MPP, U ; 

2) . Computing the second-order derivatives of the limit state surface at U using Eq. 

(4.2.21) and forming the B matrix given in Eq. (4.2.12c); 

3) . Calculating the orthogonal matrix H based on the procedure given in Section 4.2.1; 

4) . Computing the approximate curvatures Kj of the failure surface at the MPP using 

Eq.(4.2.20); 

5) . Computing the failure probability P } using Breitung’s formula of Eq. (4.3.14) or Tvedt’s 
formula of Eq. (4.3.17). 

A significant reduction in computer effort comes from the use of approximate functions in 
step 2 for the second-order derivatives because exact analysis is avoided. Therefore this method 
is particularly suitable for problems having implicit performance functions needing large scale 
finite element models for structural analysis. 

Example 4.8 

Compute the failure probability P, using Wang and Grandhi’s SORM for Example 4.5. 

1) . Compute the safety index and the MPP, U*i 

The safety index /? was calculated as $ = 2.3654 from Example 3.12. The MPP was located 

at £/*(— 1.6368, -1.7077) (in X-space, X*(1.8162, 1.4613)). 

2) . Compute approximate second-order derivatives at U using Eq. (4.2.21) and form the 

B matrix given in Eq. (4.2.12c); 

!>L = ^-a x = 4z 3 <t 1 = 4 x 1.8162 3 x 5 = 119.8148 
du\ dx x 

= = 4i?o 2 = 8 x 1.4613 s x 5 = 124.8218 

dui dx 2 

= 989.5592 
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^ = 1281.2631 
ou 2 


lv ^>l = 

= ^(119.8148)2 + (124.8218) 2 
= 173.0205 


B = v 2 g(^) 

1 / 989.5592 0 \ 

l V ^( C/ *)l \ 0 1281.2631 / 

3). Calculate the orthogonal matrix H based on the procedure given in Section 4.2.1; 


H M (~ 0 - 7214 0 6925 \ 

\7i / \ -0.6924 -0.7214/ 

4). Compute the main curvatures kj by solving the eigenvalues of HBH T ; 


5). 


HBH t 


/ 6.5278 -0.8423 

\ -0.8423 6.5968 


Compute the failure probability P f using the Tvedt formula (Eq. 4.3. 17) 


The first term of the Tvedt formula is the same as Breitung’s method, so 


= 0.00222059 


^ = [/?*(-£) -mi {ll(i +/ 9 K ,r i/2 -n(i+(^+i)«.)- V2 } 

»=i »=i 

= [2.3654 x $(-2.3654) - #2.3654)] 

•{(1 + 2.3654 x 6.5278)' 1/2 - (1 + (2.3654 + 1) x 6.5278)- 1/2 } 
= 2.2206 x 10 -3 
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= (/s + i)i^*c-)3) - ^/3)i - {na + j9*o- ,/a - -R^inf 1 + + i)^) _i/i ]} 

;=i 1=1 

= (2.3654 + 1) [2.3654 x $(-2.3654) - <£(2.3654)] 

.{(1 + 2.3654 x 6.5278)- 1 ' 2 - ife[(l + (2.3654 + 1) x 6.5278)- 1 ' 2 ]} 

= -1.3298 x 10 -4 

Pf _ J 4 1 + a 2 + A 3 = 0.00222059 + 2.2206 x 10 -3 - 1.3298 x 10 -4 = 0.002088 

This result is very close to the Tvedt’s result (P f = 0.002087) with the exact second-order 
gradients of the limit state surface. It means that the approximation given in Eq. (4.2.21) 
accurately represents the real failure surface in this example. Since this method doesn’t require 
any exact second-order gradient calculations, it can be used for problems where the second-order 
gradients are expensive or impossible to calculate. 

4.5 Higher Order Reliability Method (HORM) 

Based on the higher-order approximation of the failure surface given m Eq. (4.2.27), the 
approximate failure region £1 is defined as 

n= {Y\y n -{0 + '*£,*#?) >°> (4.3.20) 

t=l 

Since the random variables in Y-space are independent, standard and normally distributed, the 
n-dimensional standardized normal probability density function can be written as 

v(vuV2,~,vn) = j^™p[-\(y 2 i + yl + --- + y 2 ^ 

= <t>{y\)<t>{y 2 )-<t>{yn) ( 4 - 3 - 21 

where <f>{y x ) is the probability density function for the ith random variable with a standard 
normal distribution. 
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The failure probability given in Eq. (4.1.6a) can be computed from a formulation in Y-space. 


/ co roo roo 

... / 4>{yi)-<t>(yn-\) »-i <t>(yn)dy n dy n -i...dyi 

■ oo J — oo J p~\~ 2 ^ a i yj 71 

«=i 

n— 1 

/ °o roo r/3-f a^yj 71 

••• / <i>{y\)--4{yn-\) / i=1 <t>{yn)dy n dy n _ l ...dy 1 

■oo */— oo J — oo 


(4.3.22) 


Dividing the innermost integration of the second term in Eq. (4.3.22) over the interval (-oo, 

n— 1 n _i 

/?+ E into integrals over (-oo,/?] and (/?, /?+ £ a,yr]> Eq- (4.3.22) becomes 

* — 1 t=l 




/ oo roo r/?+ £ a, y 171 

••• / <fi{yi)— HVn-i) / ‘ =1 ^{y^dyndyn-i-.dyx 

-oo */-oo J (3 

/ OO roo 

■oo - /-oo ^i)-<Kj/n-i) [*(/? + V) - *(0)]dy n _ 1 ...<fy 1 (4.3.23) 


where 


v = E«.-yr 

i=i 


(4.3.24) 


The sign of V depends on the sign of a, and y” 1 . The failure probability calculations for the 
following five cases are described below. 


4.5.1 Case 1 - All a, are positive and m is even 


If all di are positive and tti is even, V is positive. Let f{V) represent the integral function 
given in Eq. (4.3.23), that is 


f(V) = 9(0 + V)-*(P) (4.3.25) 

The following expansion function of /(V) given in Ref. [12] is used, which is 

W + *O-$(0) = ( 1 - $ (/ ? )){!-ea:p(-^-)(l+ci )1 V+c 2>1 T 2 +C3,iy 3 +... + C7 V , 1 F Ar )} (4.3.26) 
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where N is the number of the expansion terms. This function fulfills 


/( 0) = 0 (4.3.27a) 

lim f(V) = 1 - $(/?) (4.3.276) 

V-+oo 

Based on the expansion function of Eq. (4.3.26), the failure probability is computed as 


n-1 ^(l) 


* = 

( 2 tt ) 2 J =1 *=1 


n— 1 jy( 2 ) n “ 1 n ~l 




— ' u(°) rj(°) 

fc=l f/fc fc=l 1=1,/#*: Mk n l 


n-i u( 3 ) n-i — 1 n_1 


+ C 3,l[H rr(O) 

*:=! Hk 


n— 1 


y' 

teuik Hffl? 01 ' tel tabik 


+ 3E E 


+r e 


(4.3.28) 


where 


roc l „.2 q ~,m 

ff(°) = I e s ^ dy 

(4.3.29a) 

J — OO 


fOO _ i ? ,2 _ _q_ , ,m 

H (1) = ay m e 2V c °^ dy 

J — OO 

(4.3.296) 

/*CO 1 - .2 q m 

H (2) = f a 2 y 2m e ~ 2 e °- 1 dy 

J — OO 

(4.3.29c) 

r OO 1 2 , 

#( 3 ) = I a 3 y 3m e 2 c °' 1 dy 

J — OO 

(4.3.29d) 


By using the ten-term Hermite approximate integral formula, the integration of Eq. (4.3.29) 
can be computed as 


10 ~ 1 ^2 q_<rm 

jy(o) = ^A,e«* -e" 2 ^ ^ 
1=1 

(4.3.30a) 

10 1 ^2 a _ cm 

1 = 1 

(4.3.306) 

10 1 >2 a t m 

( 2 ) = £ A,e«> • a 2 e, 2m • e 2 *‘ 

1 = 1 

(4.3.30c) 

10 1 c2 g c-m 

tf( 3 ) = ^ A<e*< • a 3 g m ■ e ^ ' c °^' 

1 — 1 

(4.3. 30d) 
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where A < and & are Hermite integral parameters which are given in Table El of Appendix E. 

If m = 2, the integration of Eq. (4.3.29) can be analytically integrated. The analytical 
formula for Case 1 was derived in Ref. [12], that is 


n— 1 


p, = *(-/?) n 


i = i yl + a j/ c o,i 

{1 ■ + 5 C " I r + 

+ ^ ( 1 rkkr> 3 + 2 g 

+12 ”i ( i+^.k. )3} + - } («- 31 > 


4.5.2 Case 2 - All a, are negative and m is even 

If all a, are negative and m is even, V is negative. The following expansion function of f(V ) 
given in Ref. [12] is used, i.e. 


$(0+V) - <£(/?) = -$(£){1 - exp(-¥-)( 1 + c h2 V + c 2 , 2 V 2 + c 3 , 2 V 3 + ... + c^, 2 ^)} (4.3.32) 
which fulfills 


/(0) = 0 


(4.3.33a) 


v hm oo f(V) = -*(t3) 


Based on Eq. (23), the failure probability is computed as 


(4.3.336) 


Pi = 


'll, 1 - ln\ 71-1 n-1 J/( 2 ) n-1 n— 1 frl 1 ) rr(r) 

1 ' ' ■ *■ " * "£ # ‘ w * £ 14* 


fc=l *=1,/^* "f 

( v£f , "f- 1 v- 1 jjfgg , a fff 


210 



(4.3.34) 


where 


r CO 1,,2 1 Q ..m 

#(°) = f e 2 e °* 2 dy 

J — oo 

(4.3.35a) 

if! 1 ) = / ay m e 2 c °- 2 dy 

J — OO 

(4.3.356) 

roc _1„2 l _. a t. 771 

tf( 2 ) = / a 2 y 2m e * v *»■» dy 

J — CO 

(4.3.35c) 

/•CO 1 n 2 ■ q ■..m. 

#( 3 ) = [ a 3 y 3m e 2 00 ' 2 dy 

J — OO 

(4.3.35d) 


By using the ten-term Hermite approximate integral formula, the integration of Eq. (4.3.35) 
can be computed as 


AU o 1 f 2 i a 

t=l 

10 

j?0> = £>«<? 


1 c2 1 q tm 

2 <i » T Cf) 5 


i=l 


10 _ 1 >*2 | q tm 

i=l 

10 _ 1 ^2 I a cm 

m*)='£\ i e$ ■(pg'-e'*' ^ ‘ 

1=1 


(4.3.36a) 


(4.3.366) 


(4.3.36c) 


(4.3.36<f) 


If m = 2, Eq. (4.3.35) can be analytically integrated. The analytical formula for this case 
was derived in Ref. [12] that is 


n— 1 


p, = !-*(/?) n 


* + Wi + r ^> ! + 2 §< t^i 

1 * \3 . ^ a > _ VI — 1 2 + 12 , T( , a< — 

+ gC 3)2 [(g t _ a . /co2 ) + ^ 1 - ajcoa h. 1 - a */ Co - 2 *=i 1 _ G,/C0 ’ 


-) 3 1 + -} 


(4.3.37) 
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4.5.3 C ase 3 - Some a, are positive, some a,- are negative, and m is even 

If some a, are positive, some a, are negative and m is even, V is divided as 

V = Vi 4- V 2 

where 

n— 1 

Vi = a 'VT > 0) a i > 0 (i = l,2,...,n — 1) 

t=rl 
n— 1 

^2~YL a iyT < 0, a, < 0 (i = n,n + — 1) 

i—fi 

The following expansion function of f(V) given in Ref. [12] is used, i.e. 


$(/? + Vi + V 2 ) - $(/?) = $(-/?){l -exp(-— )(1 + c ltl Vi +c 2 ,i7 1 2 H 

co,i 

■exp(- )(1 + di i2 V 2 + ...) 

“ 0,2 

- W){1 - exp(— )( 1 + c h2 V 2 + c 2 , 2 F 2 2 + . 

C0,2 

•exp(--^)(l + d u V 1 + ...) 
ao,i 

This expansion function satisfies 

/( 0) = 0, Vi = V 2 = 0 
lim f(V ) = 1 - $(£), at V 2 = 0 

— »-CO 

Tim f{V) = -$(/?), at V r = 0 

*2 — * — OO 

Based on Eq. (4.3.40), the failure probability can be computed as 




( 27 r) 2 j=n 


n— 1 


n-i jy(l) 


J=1 1 


(4.3.38) 

(4.3.39a) 

(4.3.396) 

I-.-)} 

••)} 

(4.3.40) 

(4.3.41a) 

(4.3.416) 

(4.3.41c) 
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(4.3.42) 


n— 1 


n— 1 jy(l) 


) 


~*%Wl i+^E|fe + - 

(27r) 2 j=l *=1 ■*** 

n -l n-1 f/l 1 ) 

fc=n 


j=n 


where ifW(t = 0,1, 2, 3) can be calculated using Eq. (4.3.29) or (4.3.30), but c<>,i is replaced 
by d 0 1 - Also, H (i) (i = 0, 1,2,3) can be computed using Eq. (4.3.35) or (4.3.36), and co, 2 is 

replaced by do, 2 . 

If m = 2, Eq. (4.3.42) can be analytically integrated, and the analytical formula for this 
case was derived in Ref. [12], that is 


Pf 


•EJ 1 , 1, ai 

$(-/?) - *(-0) n / ~; / ~T ~ ( 1 + 2 dl ' 7 S 1 - a */^0.2 

j=n y 1 dj/th 0,2 *— n 

"-? 1 . 1 ^4 fl * -L U 

■d - n -r - (1 + 2 Cl>2 5 1 - */«,;; + - )} 

j=h y 1 aj/Co,2 t “" n 


+ ...) 


(4.3.43) 


4.5.4 Case 4 - All a, are positive or negative and m is odd 


In order to solve the cases with an odd m and positive a t or with an odd m and negative 
ai , V is divided into two parts, 


Vi = E 1 a iy r, Vi > 0 

*= 1 

| y 2 = n £ ai y?, yi < o 


(4.3.44) 


Since m is odd, V a is positive and V 2 is negative if all a { are positive, and V x is negative and 
V 2 is positive if all a,- are negative. Assuming that all a, are positive, and Vi > 0 and V 2 < 0, 
the function f{V) is expanded as 
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* 0 ?+v)-* 0 ?) = 


J $(- 0 ){ 1 - exp{-fj)( 1 + c u V i + d,!^ 2 + C3.1V; 3 + ...cjv.iV;*)}, v; > 0 

l -$(/?){l - exp(^L)(l + C 1 | 2 F 2 + c 2y2 V 2 + c 3 , 2 V 3 + ...C 7 V, 2 V^)}, V 2 < 0 

(4.3.45) 

This expansion function also satisfies Eq. (4.3.41). Based on this function, the failure 
probability can be computed as 


1 $(-8) n s} "- 1 W »“1 r< 2 ) n-1 n-X r(l)r(l) 

( 27r ) 2 J=1 *=1 L k k=1 L\ k=1 l=1Mk L^'LY’ 

n-l r(3) n-1 n-1 r(2)r(l) „_i n _i n -l r l 1 ) r (1) r (1) 

**£#+*£ ,E zfefw + E E E + -> 

k k—1 L/fc Lf [ &=1 /=l,/^& p=:l } pykl } pjtfc L ^ L [ Lp 


’ u Sxl°» + ! ' 2[ Slf + S JjfcipzprJ 


n-1 r (3) n-1 n-1 f(2)r(l) n-1 n-1 n-1 

+**E|fe + »E E MW + E E E 

fc=l fc=l /=l,i?4fc L; A=1 /=1 P=l,p^i, 


WWW. 


Y Y Y — ' zE- i + 1 

, , ^ ^ r(°) ? (0) ? (o) j ^ *"j 

A — 1 l=zl,l^ik p=l,p^l,p^k k L k Z/j Lp 


L(°) = J“ dy 

i<» = r dy 

Jo 

w= 

*/o 

T< 3 > =raY m e~^~^ yJn dy 


ay e 


4v 2 — — v m , 

2 ‘•w* dy 


— • /*\ i ..2 i o - >tx 

Z (°) = / e -2V +^V ^ 

j — OO 

Z* 1 ) = /° ay m e~* y2+7 °2 ym dy 

J — OO 


Z< 2 > = /° a 2 y 2m e~^ y2+ ^ ym dy 

J — OO 
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(4.3.476) 


/ O 1 „2 ■ a ,,m 

a 3 y 3m e 2 

-oo 

Since the integrations of Eqs. (4.3.47a) and (4.3.47b) are from 0 to oo and from -oo to 
0, a nine-term Laguerre approximate integral formula is used to compute the integral of Eq. 

(4.3.47). 


£(°) _ A,e 4 ' • e 

1-1 


1 ^2 a cm 
£i . * 2 *** 


t=l 

9 

1 = 1 
9 


L< 3 > = H A<e<‘ - a 3 f f” - e 



1 p a crn 

e 2 co, l St 

• «c • 

a 2 g m 

1 p a cm 

. e 2 *** co,!^* 

3c3m 

a C; 

1 p a cm 

. e 2^1 c 0 ,i s < 


(4.3.48a) 


1 = 1 


9 _ .. _\.p _ a tm 

I(°) = 53 A t e 4i • e ^ ‘ 

1=1 

9 _ _ 1 p a cm 

ZrCD = _^A^' • a # 1 • c ^ ^ ’ 

»=i 

I< 2 ) = £ • a 2 £ m • e' 2 * 1 "^ 1 " 


i=i 
9 


X(3) _ _ ^2 \ ie Z< . a 3 £f m ■ e ^ (4.3.486) 

1=1 

where A; and l are Laguerre integral parameters which are given in Table E2 of Appendix E. 

If all a, are negative, and Vi < 0 and V, > 0, the failure probability formula is similar to Eq. 
(4.3.46). But the integration interval of Eq. (4.3.47a) is from -oo to 0 for I (i >(> = ‘i 2 . 3 ) 

and Eq.(4. 3.47b) is from 0 to oo for l<0(i = 0, 1,2,3). Eq. (39a) becomes 


» _ 1 72 \ a- cm 

L(°) = ^ A,e Ci • e ^ 


i=i 


9 _ j_ 72 I q cm 

IF> = -Y, 


t=l 
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(4.3.49a) 


£ (J > = y v • « 2 e7™ ■ e -^ + * f ” 
1=1 

I( 3 ) = _ £ A,e«‘ • a 3 g m • e'^ + ^ 


1=1 


Eq. (39b) becomes 


z<°> = £ 

x=i 

X<‘> = ZA,eSafi”-e- ie+ * f! " 

1=1 

Z(2) = £ A,. e 6 . . C -H? +*$• 

t=l 

1(3) = £ A,/- . a 3^m . e -H?+^ 

1 = 1 

4.5.5 Case 5 - Some a, are pos i tive, some a, axe negative, and m is odd 

If some a, axe positive, some a, are negative, and m is odd, V is divided as 

( Vl = Ui + U 2 , 

v = l 


where 


n— 1 


t=l 


n— 1 

E 

t=n 
n— 1 


n— 1 


t=l 


(4.3.496) 


y, > 0 


Vi< o 

(4.3.50a) 

2, ...,h — 1), y t >0 

(4.3.506) 

...,n — 1), t/,>0 

(4.3.50c) 

...,n- 1), yi < 0 

(4.3.50d) 

2, ..., h — 1), y, < 0 

(4.3. 50e) 


In this equation, «i and Ui are positive, and u 2 and u 2 are negative. By combining Case 3 and 
Case 4, the function f(V) is expanded as 
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$( P + v )-*{ P ) 


$(_£){1 - exp(-^-)(l + cum + C 2 il u\ + ...)} • exp(^)(l + <*1,2*13 + -) 
_$(/ 3 ){l - exp(£)(l + ci, 2 u 2 + c 2 , 2 til + ..•)} ' exp(-^)(l + di,iui + -) 

at yi > 0 


$(-/3){l - exp(-^)(l + c ltl ui + c 2>1 u? + ...)} ‘ exp(^)(l + d h2 u 2 + ...) 
_$(/?){l - exp(^)(l + c li2 u 2 + c 2 , 2 u 2 2 + •-)} ’ esPl-fe-K 1 + 

at yi < 0 

(4.3.52). 

This expansion function satisfies Eq. (4.3.41). Based on this function, the failure probability 
can be computed as 


Pf = 


n— 1 


(2tt)' 


n— 1 /-(+ 1 ) 

*(-« - 'ff Ilfd +^Ep + -) 

_. = _ fc=n b k d 


n — 1 


fi-1 r(+l) 
L k 


-{1 - n ^ +0) (1 + 1: 7W + "■) - -> 


3=1 ^=1 k . . 

- 1 r (+l) n— 1 n ” 1 n + 

ff iS 0 ’d + *.1 e +•••)• d - n £ r<i + <=« e ip + - ) - 

(2*Pi-i wI W fc “ n fc 


k=n ^ k 
n-1 r( — !) 


n i'r/’a + <*« e yr4 + •••> d - n ^r’u + e ^fe> + •••> 


(27 r) 2 j=i 

JK/ 

(27r) * j=fi 


fc=l Lk,d 

n-1 ^(-1) 
r(~ 0) 


j=n 
n — 1 


k=n L k 

+-^L n i5?’(i + *4 e §4 + •••) • d - n r'd + e jU + ■••) - 

' — tJk k=n L k<d 7=1 *“* k 




•••} 

•••} 

...} 


(4.3.53) 


where l' +i> and £$> (i = 0,1, 2,3, j = 1,2, ...h - 1) are the integrations corresponding to 

UI („, > 0) and are given in Eqs. (4.3.47a) and (4.3.48a), but on,, is replaced by do,, for L&> 
integrations. lH and (i = 0, 1, 2, 3, j = ft,..., n-1) are the integrations corresponding 

to u. (0. > 0), and can be calculated using Eq. (4.3.47a), but the integral interval is 

from -co to 0. Its Laguerre formula is given in Eq. (4.3.49a). For L\ d \ co,. in Eq. (4.3.49a) 

T 7 (-H) i f (+0 /• 0 19 1 7 — n ti — 1) arc the integrations 

is replaced by d 0 ,i • Lj and L ),d (* - U, 1,4,4, 3 n ’-’ 7t ; 
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corresponding to u 2 (u 2 < 0), and Lj +,) can be computed using Eq. (4.3.47b), but the integral 
interval is from 0 to +oo. Its Laguerre formula is given in Eq. (4.3.49b). For L^ + J\ Cq 2 in 
Eq. (4.3.49b) is replaced by d 0 , 2 . L ( f l) and (i = 0,1, 2, 3, j = 1 - 1) are the 

integrations corresponding to u 2 (u 2 < 0) and are given in Eqs. (4.3.47b) and (4.3.48b), but 
Co, 2 is replaced by d 02 for 

In Ref. [12], the coefficient c tJ (i = 0,1, 2, 3,..., j = 1,2) was calculated by comparing 
the same order terms (first-order, second-order and third-order derivatives) on both sides of 
the expansion functions. The formulae for calculating c, tl and c, j2 for Case 1 and Case 2 with 
one-term, two-term and three-term approximations are given in the Appendix F. For Cases 3, 
4 and 5, the coefficient c,-^ is identical to the results of Case 1, and c,-^ is identical to the results 
of Case 2. The coefficients d 0 , i and d 0 , 2 with d hl = d 2>l = ... = 0 and d ia = d 2t2 = ... = 0 are 
calculated as 

<* 0,1 = 2co,i (4.3.54a) 

<* 0,2 = 2co,2 (4.3.546) 

4.5.6 Flow-chart 

The flow-chart given in Fig. 4.7 shows the scheme of the higher-order reliability method. 
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Fig. 4.7 Schematic Flow - Chart 
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Example 4.9 


This example has a highly nonlinear performance function, which is 

g(x ux 2 ) = 2.5 + 0.00463(xi + x 2 - 20) 4 - 0.2357(xi - x 2 ) 

in which x x and x 2 are the random variables with normal distributions (mean x x = 10, x 2 = 10; 
standard deviation <j\ = a 2 = 3). Compute the failure probability using HORM. 

1) . Compute the safety index and the MPP, {/*; 

The safety index /3 is calculated as /? = 2.5. It requires 3 g-function and 2 gradient 
calculations. The MPP is located at £/*(l. 7678, -^1.7678) 

2) . Rotate the standard normal U-space to the new standard normal Y-space; 

The orthogonal matrix can be solved by using the procedure given in Section 4.2.1. 

h _ / 72 \ / 0.7071 0.7071 \ 

\7i / \ 0.7071 -0.7071/ 

Using Y = HU, The coordinates in the rotated standard normal space at the MPP can be 
obtained as Y’/0, 2.5) 

3) . Select two additions on the limit state surface and construct the adaptive approximation. 
Two points on the performance function are found as Y a (-0. 25, 2.50588) and 

Y.(0.25, 2.50588) by using the approximate performance function which is constructed in 
computing the safety index. The approximation in Y-space is constructed as 


2/2 = 2.5 H- 

This approximation passes through Y a , VJ, and Y*, so it has a good accuracy around the MPP. 

4). Calculate the failure probability using HORM; 

Since the nonlinearity index m equals 4 and a x = 1.5 > 0 (Case 1), Eq. (4.3.28) is used for 
calculating the failure probability. The failure probability calculated by using Eq. (4.3.28) is 
0.003042, which is quite close to the Monte Carlo solution (P f = 0.00297). The results obtained 
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from Breitung and Tvedt’s methods are the same as the result of FORM IP, - 0.006209), which 
shows that there is no improvement over FORM for this highly nonlinear problem because the 

curvatures at the MPPs are zero. 

4.6 Comparison of Different Methods 


Example 4.10 

The performance function in U-space is 


,U\ + ti 2 . 2 / u i 

9 (ui,u 2 ) = 1.0 + ( 7 ) ~ (' 


_^ 2 ) 2 


a 


in which ttl and u 2 are the random variables with standard normal distributions; a and b can 
be any values. In this example, a is fixed to be 2.0. Three cases are considered with different 

b values (Case 1: a = 2, b = ±0.5; Case 2: a = 2, b = ±2; Case 3: a = 2, b = ±4) 

In three cases, the MPP search is carried in U-space using an efficient safety index algorithm 
[6]. In this 0 search, the TANA2 approximation presented in Ref. [15] is used. Case 1 and 
Case 2 require 3 g-function and 3 gradient calculations, and Case 3 requires 8 g-function and 7 
gradient calculations. The coordinates in the rotated standard normal space at the MPP are 
y (0,0.3537), F* (0,1.4130), and y*(0, 2.8284) for cases 1, 2 and 3, respectively. In order to 
construct the approximation in the neighborhood of the MPP, two points on the performance 
function are found as y o (-2.1460, 0.6462) and Y b (2.1460, 0.6388) for case 1 , y o (-2.1460,2. 7024) 
and y fc (2.1460, 2.4460) for case 2, and y a (-2.1460, 5.1427) and *(2.1460,5.1376) for Case 
3. This is done by using the approximate performance function which was constructed m 
computing the safety index. No extra exact analyses were needed. By following the procedure 
given in Eqs. (8-13), the approximation can be obtained as 


' 0.3537 + 0.06352^, 

Case 1 

< 1.4130 + 0.28000y?, 

Case 2 

k 2.8284 + 0.50144^, 

Case 3 
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The approximate curvatures of three cases at the MPP are 0.12704, 0.5600, and 1.0029, 
respectively. It is obvious that the above three approximations for three cases pass through 
the corresponding Y a , Y b and Y*, therefore they can provide good fit approximations for failure 
probability calculation in a larger neighborhood of the MPP. Since the nonlinearity index, m, 
equals 2, the closed form formula given in Eq. (4.3.31) is used to calculate the failure probability. 

Fig. 4.8a depicts the iteration history of the safety index search, and Fig. 4.8b shows that 
the two-point adaptive approximation is closer to the exact limit state surfaces than the FORM 
and SORM approximations for the failure probability calculations. The numerical results of 
Pf/2 are shown in Table 4.3, which indicate that the failure probability calculated by using 
HORM is quite close to the Monte Carlo simulation, while the Breitung and Tvedt methods 
are less accurate. The Cai-Elishakoff method resulted in an impractical value for Case 3. The 
Koyluoglu- Nielsen and HORM gave similar P f predictions. In HORM, there is no need for the 
second-order gradients information. 

In addition, FORM, SORM and HORM all lose accuracy because the limit state surface is 
not a continuous curve in U-space or Y-space. There is no good way to predict whether or not 
the limit state surface will fall apart. However, one may be able to find the neglected part if 
some tests can be done before Pf is calculated. For example, after finding the MPP, Y a and Y b , 
we can substitute (0,0,...,-/?), (-*/?, -k/3,... -k(3, and (*/?, k(3, - m ) into the 

limit state function. If all three points are also on the surface, it means that the limit state 
surface consists of two symmetrical parts. Therefore, the failure probability obtained from 

FORM, SORM and HORM needs to be doubled. This test requires 3 additional g-function 
calculations. 

Example 4.11 

The performance function is 

/ \ r> nnrn 0.025\/2 « 

g(x u x 2 ) = 2.2257 (xx + * 2 “ 20 ) + 0-2357(x 1 - x 2 ) 
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FI*. 4.8a Bela Search Us in* TANAS (Case 4) 



FI*. 4.8b Approximations for Pf Calculations (Case 3) 
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Method 


FORM 
P, = *(-/?) 


Breitung 



Cai- 

Elishakoff 


Koyluoglu- 

Nielsen 


Monte 

Carlo 


HORM 


Table 4.3. Failure Probability Comparisons for Example 4.10 


Exact Analysis for P, Failure Probability 

. PjJ _ 2 

g-func. First-order Second-order Case 1 Case 2 Case 3 

Calculation Gradients Gradients 


0.36179 0.07883 0.00234 


.35098 I 0.05578 I 0.00105 



sample size=100,000 



0.34768 I 0.05316 I 0.00101 


0.33077 I 0.04965 I -0.03269 


0.33073 | 0.05057 I 0.00099 


0.33659 I 0.05435 I 0.00108 


0.33899 I 0.05405 I 0.00106 


Table 4.4. Failure Probability Comparisons for Example 4.11 


Exact Analysis for P f 


g-func. First-order Second-order Failure Probability 
Calculation Gradients Gradients Pj 


0 0.013014 


0.013014 

































































Fig. 4.9 A Circular Shaft Subjected to External Bending Moments and Torque 


in which i, and are the random variables with normal distributions (mean *i = 10, 2j - 10; 
standard deviation cr\ = o-i = 3). 

The MPP search using an efficient safety index algorithm [6] requires 3 g-function and 2 
gradient calculations. The coordinates in the rotated standard normal space at the MPP are 
Y*(0, 2.2257). Two points on the performance function are found as Y a (-0.22226, 2.22471) and 
Y fc (0.22258, 2.22691) by using the approximate performance function. No extra exact analyses 

are needed. The approximation is 

y 2 = 2.2257 - 0.1 y\ 

Since the nonlinearity index, m, equals 3 and a x = -0.1 < 0 (Case 4), Eq. (4.3.46) is used 
to calculate the failure probability. The results shown in Table 4.4 indicate that the failure 
probability from HORM is quite close to the Monte Carlo solution (P/ = 0.019188), while the 
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results obtained from Breitung, Tvedt, and Koyluoglu-Nielsen SORM methods are the same as 
the FORM result. This shows these SORM methods provide no improvement over the FORM 

because the curvatures at the MPP are zero and the curvature-fitted paraboloid reduces to the 
tangent plane. 

Example 4.12 

This example is taken from Ref. [13], which is a circular shaft with one end clamped and 
one end free (Fig. 4.9). The structure is subjected to two external moments M y and M z and a 
torque T. The moments M y , M z and torque T are assumed as independent random variables 
with normal distributions. The mean values of M y , M z and torque T are /z a , P2 and fi 3 , and all 
the standard deviations are a. The reliability of the shaft depends on the stresses at the point 
A which has the maximum tensile and shear stresses and can be calculated from 

R = ^ 3/2 j j f Q eX P[~\( U l + «2 + ul)\d Ul du 2 du Z 

where u t , u 2 and u 3 are standard normally distributed random variables of M y , M z and T. The 
safe domain in X-space is described by 

g(M„ M„T ) = (^) 2 + f + - e* < 0 

C (J (j 

In U-space, the safe domain is a non-central sphere 

g(u u u 2 , u 3 ) = ( Ul + ^ ) 2 + (u 2 + — ) 2 + (n 3 + - e 2 < 0 

cr a a 

where e = ( v j 4ld ) 2 , and M yteld > M y + M 2 -f T 2 . e is the radius of the non-central sphere. An 
exact solution was obtained in Ref. [13] as 

R = $( r + e ) - $(r - e) + —^{ exp [-l( r + e )2] _ e xp[-^(r - e) 2 ]} 

where 

= t — r + <— ) 2 +<— ) 2 

<J (J (J 
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Fig. 4.10* Reliability of Example 4.1* C r« «M» ) 



Fig. 4.iOb Reliability of Example 4.12 < r«0.1 ) 
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ns. 4-IOc MhMIHjr of Example 4.18 ( r>U) ) 



ns- 4.!Od Reliability of Example 4.18 ( r«8.0 ) 
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Figs. 4.10a-4.10d show the exact and approximate reliability results of the shaft with four 
different values of r (Case 1: r=0.05; Case 2: r=0.1; Case 3: r=1.0; Case 4: r=2.0). For all four 
cases, the nonlinearity index m is equal to 2, and the closed form formula given in Eq. (4.3.37) 
is used for calculating the failure probability, a, given in Eq. (4.2.27b) are calculated by the 
adaptive two-point approximation discussed in Section 4.2.5, so exact second-order derivatives 
are not required for the curvature calculations. In Figs. 4.10a-4.10c, the higher-order and 
Koyluoglu- Nielsen methods are the closest to the exact results even when e is small. Also,' 
the results of HORM are almost the same as Koyluoglu-Nielsen’s, which indicates that the 
procedure given in Eqs. (4.2.22)-(4.2.27) for constructing the approximation is very effective 
and accurate. The FORM gives poor accuracies when e is less than four, i.e. when the failure 
surfaces are closer to the origin. The Breitung’s method yields good results when r is not small 
and e is greater than 2.0 for Case 3 and greater than 3.0 for Case 4, as shown in Figs. 4.10c 
and 4.10d. However, when r is small, the Breitung’s method produces large errors; it is even 
worse than the FORM, as shown in Figs. 4.10a and 4.10b. Particularly, the Breitung’s method 
resulted in impractical reliability values; for example, the probabilities are -0.0284, -1.2313 and 
-2.5005 when r is 2.0, 1.5 and 1.0, respectively. The Cai-Elishakoff method produces similar 
results to the present and Koyluoglu-Nielsen methods when e is greater than 2.5 for Cases 1 
and 2, and greater than 2.0 for Cases 3 and 4. The Tvedt method is not valid for Cases 1, 2 
and 3, but it provides the best results for Case 4. 


4.7 Summary 

In this chapter, several failure probability methods are presented. FORM can provide good 
results for the failure probability calculation when the limit-state surface is nearly linear in 
the neighborhood of the MPP. It is simple and doesn’t require any additional calculations. 
For problems with larger curvatures, SORM needs to be used to avoid unreasonable and 
inaccurate FORM results. However, when the limit state function curvatures are higher at 
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the MPP, results obtained using SORM may be inaccurate. For example, the curvature fitted 
paraboloid approximations of SORM can’t improve the accuracy for the cases shown in Fig. 
4-4. Also, Breitung and Tvedt methods are not valid for / 3 kj ^ — 1 and do not work well in the 
case of negative curvatures. HORM is needed in these situations. Furthermore, HORM can 
be effectively used for the problems requiring expensive or impossible second-order gradient 
calculation of the performance function without incurring expensive computations. In HORM, 
the additional mathematical steps involved in building the higher-order approximations needed 
the Hermite and Laguerre integral formulations. 

* 
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CHAPTER 5. SYSTEM RELIABILITY CALCULATION 


The safety index and failure probability calculations in Chapters 3 and 4 were aimed 
primarily at assessing the reliability of one element against failing in one particular failure 
mode. In fact, a real structure generally consists of many elements. Even in simple structures 
composed of just one element, various failure modes such as bending action, shear, buckling, 
axial stress, deflection, etc., may exist and be relevant. The composition of many elements in 
structures is referred to as a structural system”. A system may be subject to many loads,' 
either single or in various combinations. Therefore, the reliability analysis of structural systems 
involves consideration of multiple, perhaps correlated, limit states. Considering the structural 
reliability just on an individual element failure may not give a safe estimation for the structural 
system. A more reasonable and accurate probabilistic analysis should consider the correlation 
of multiple failure modes. 

In this chapter, some basic definitions and concepts are introduced in Section 5.1; the 
failure mode approach is given in Section 5.2; the series and parallel systems are introduced 
in Sections 5.3 and 5.4, respectively; system reliability bounds are given in Section 5.5, and 
system reliability calculations using approximations are given in Section 5.6. 

5.1 Basic Definitions and Concepts 

5.1.1 Failure Element 

In system reliability, each failure mode for a discipline or an element of a structural system is 
called a failure element or member. An element (or material behavior) in structural engineering 
is usually idealized as one of the forms of strength-deformation relationships shown in Fig. 5.1. 

Elastic behavior (Fig. 5.1a) corresponds to the maximum permissible stress concept. With 
this idealization, failure on any one location within the structure, or of any one element, is 
considered to be identical to structural failure. Although this is clearly unrealistic for most 
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structures, it is nevertheless a convenient idealization. 



Fig. 5.1 Various strength - deformation (R- A) relationships 

When one load system acts on a structure, the location of the peak stress or stress resultant 
can be identified from an elastic stress analysis. For such an analysis, use of deterministic elastic 
properties and dimensions is often adequate, owing to the very low coefficient of variation 
associated with these variables [1], When more than one load system acts, the location of 
the peak stress (resultant) will depend on the relative magnitudes of the load systems, and 
several candidate locations or members may need to be considered. For large structures, such 

identification may not be easy by inspection alone. 

Brittle failure of an element does not always imply structural failure, owing to redundancy 
of the structure. The actual member behavior can therefore be better idealized as “elast.c- 
brittle” indicating that deformation at zero capacity is possible for a member, even after the 
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peak capacity has been reached (Fig. 5.1b). 

Elastic-plastic element behavior (Fig. 5.1c) allows individual members or particular regions 
within the structure to sustain the maximum stress resultant as deformation occurs. When the 
elastic member s stiffness approaches infinity, this behavior is known as idealized rigid-plastic 
behavior. A generalization of both elastic-brittle and elastic-plastic behavior is elastic-residual 
strength behavior (Fig. 5. Id) and a further generalization is elastic-hardening (or softening) 
behavior (Fig. 5.1e). The latter may be seen as an approximation to general behavior including 
post-buckling effects. Even without introducing reliability concepts, the analysis of these latter 
behaviors is complex. Of course, general non-linear (curvilinear) strength-deformation relations 
(Fig. 5. If) present even more difficulties. 

5.1.2 Element Failure Probability 

Element failure probability Pf is the failure probability of each failure element. P/ can be 
calculated using the first-order reliability method (FORM), the second-order reliability method 
(SORM), or the higher-order reliability method (HORM) introduced in Sections 4.3, 4.4 and 
4.5, respectively. 

5.1.3 Joint Failure Probability 

Joint failure probability is the union probability of every two failure modes, which considers 
the combined effects of two or more elements. The joint failure probability can be calculated 
by approximating the joint failure region by the linear safety margins at the MPP of each 
failure surface (first-order system reliability analysis), or at the joint point U?. on the joint 
failure surface closest to the origin (second-order system reliability analysis). The details of 
computing the joint failure probability are given in Section 5.6. 

5.1.4 Structural Failure 

Structural failure (as distinct from individual element or material failure) may be defined 
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in a number of ways, including the following: 

(i) Maximum permissible stress is reached anywhere (<r(x) = a max ); 

(ii) (Plastic) collapse mechanism is formed (i.e. zero structural stiffness is attained), 

(iii) Limiting structural stiffness is attained; 

(iv) Maximum deflection is attained; 

(v) Total accumulated damage reaches a limit (e.g. as in fatigue). 



Fig 5.2 Fault-tree representation 


Structural failure modes consisting of the combined effects of two or more elements or 
material failure events, such as statically indeterminate structures, are of particular interest 
in the determination of structural system reliability. If all failure modes for the system have 
been identified, the various events contributing to these failure modes can be systematically 
enumerated using the “fault-tree” concept. An example of a fault-tree is shown in Fig. 5.2b 
for the elementary structure of Fig. 5.2a. The procedure is to take each failure event and 
to decompose it into contributing subevents, which are themselves decomposed in turn. The 
lowest subevents in the tree correspond, for structures, to member or material failure. At this 
level (if not earlier) limit state equations can be written. 
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5.1.5 System Failure Probability 


System reliability concerns the formulation of the limit states and calculation of the system 
failure probability when the system has more ways of failing. System failure probability includes 
the element failure probabilities and joint failure probabilities. The calculation of the system 
failure probability is given in Section 5.6. 

5.1.6 Multi-dimensional Standardized Normal Distribution Function 

Since the multi-dimensional standardized normal distribution function is important for 
computing the system failure probability, particularly the joint failure probability, the definition 
and mathematical details are introduced in this section. The k-dimensional standardized normal 
distribution function is defined as 

♦*<*; p) = r m n (5.1) 

J -°° j = i V 1 P 

where p = [p tJ \ is the correlation matrix for the linearized safety margins. 

Assume k = 2 and two linear safety margins Mi and M 2 are given as 

Mi = a 0 - ( ai ui + ... + a n u n ) (5.2 a) 

M 2 = b 0 — (bill! + ... + 6 n ti n ) (5.2 b) 

where u t ( i 1,2, ...n) are standard normal variables; Mi and M 2 are standardized normally 

distributed variables with the correlation coefficient p , where 

n 

P = Y, (5.3) 

t = l 

^ *^1 — ( a i i and ct 2 = (b \, .... b n j are chosen as unit vectors, the correlation coefficient 

p can be written 


p = cos(u) 


(5.4) 
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where v is the angle between the unit vectors ft and ft (Fig. 5.3, where p > 0). 



Fig 5.3 Geometrical illustration for p and approximate <I> 2 calculations 

With the above p, the bivariate normal distribution function $ 2 can be calculated as 


-fa P ) = H-m(-fr) + £ M-fa -fa z ) dz (5 - 5) 

in which M-fa -fa z ) is the P robabilit y denslt y Action for a bivariate normal vector with 
zero mean values, unit variances, and a correlation coefficient z, which is given as 


h{-fa~fa z ) = 


fa + ft 2 — 2 zfijflj 


27r\/l — z 2 


l-z 2 


From Eqs. (5.5) and (5.6), $ 2 must be evaluated numerically, but simple bounds on $ 2 
can be given to avoid any numerical integration. For practical purposes these bounds will 
generally be sufficient. Fig. 5.3 shows a situation with p > 0. The reliability indices ft and 
ft corresponding to the safety margins M x and M 2 are equal to a 0 and 6 0 , respectively. The 
joint failure probability P/ 2 is equal to the probability content in the shaded region (angle 
BAE). Therefore, P( 2 is greater than the probability contents in the angles BAD and CAE. 
However, P{ 2 is less than the sum of the probability contents in the angles BAD and CAE. This 
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observation makes it possible to find simple bounds for P/ 2 = $ 2 (-/?,, -fa p). The probability 
content Pi in the angle CAE is equal to 


Pi = *(-A)*(-tO 

and likewise the probability content P 2 in the angle BAD 


(5.7) 


P 2 = $(-&)$(- 7l ) 


(5.8) 


where 71 and 72 are shown in Fig. 5.3. By simple geometrical considerations 


P2 - pPi 

V 

Pi — pP 2 

vw 7 

Therefore, for p > 0, the following bounds exist 


72 = 


7i = 


(5.9) 

(5.10) 


max(Pi, P 2 ) < Pf < Pi + P 2 


(5.11a) 


max(P u P 2 ) < $ 3 (-fa-fa p ) <Pi+P 2 
For p < 0, the following bounds can be derived 


(5.116) 


0 < $ 2 (~/?i, -fa p) < min(Pi, P 2 ) (5.12) 

5.2 Failure Mode Approach 

The failure mode approach is based on the identification of all possible failure modes for the 
structure. A common example is the collapse mechanism technique for ideal plastic structures. 
Each mode of failure for the structure normally consists of a sequence of element “failures” 
(i.e. reaching an appropriate element limit state) sufficient to cause the structure as a whole 
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to reach a limit state such as (a)-(e) mentioned in Section 5.1.4. The possible ways in which 
this might occur can be represented by an “event tree” (Fig. 5.4) or as a “failure graph” (Fig. 
5.5). Each branch of the failure graph represents the failure of an element of the structure, 
and any complete forward path through the branches starting from the “intact structure” node 
and concluding at the “failure” node represents a possible sequence of element failures. This 
information is also conveyed in the event tree. 



Fig. 5.4 Event - tree representation for structure of Fig. 5.2a 



Stuctural 

Failure 

dummy 


Fig. 5.5 Failure-graph representation for structure of Fig. 5.2a 

Since failure through any one failure path implies failure of the structure, the event 
“structural failure” {F.) is the union of all k possible failure modes: 
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Pf = P{F S ) = P(F 1 U F 2 U ...U F k ) (5.13) 

where Fi is the event “failure in the ith mode”. For each such mode, a sufficient number of 
elements (or structural “nodes”) must fail; thus 


P(Fi) = P(F U n F 2i n ... n F k -) (5.14) 

where F is the event “failure of the j th element in the ith failure mode” and k[ represents the 
number of elements required to form the ith failure mode. For the simple example of Fig. 5.2a, 
there are m = 3 failure modes, and k[ = 3, k' 2 = k' 3 = 2. 

It is important to note that the failure mode approach is unconservative with respect to 
element failure. If the possibility of element failure (or one or more of the element failure 
modes) is ignored, the failure probability of the structure will usually be underestimated [2], 

5.3 Series Systems 

The series system is one kind of structural system idealization. In a series system, typified 
by a chain, and also called a “weakest link” system, attainment of any one element limit 
state constitutes failure of the structure (Fig. 5.6). For this idealization, the precise material 
properties of the elements do not matter. If the elements are brittle, failure is caused by element 
fracture; if the elements have a plastic deformation capacity, failure is caused by excessive 
yielding. It is evident that a statically determinate structure is a series system since the failure 
of any one of its members implies failure of the structure. Fach element is therefore a possible 
failure mode. The system failure probability for a weakest link structure composed of k elements 
is computed as [3] 


Pf — P{F\ U F 2 U i*3 U ... U Fk) 


(5.15) 
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Compared to Eq. (5.13), this shows that the series systems formulation given in Eq. (5.15) 
is of the “failure mode” type. 

If each failure mode Fi{i = 1,2, ..., k) is represented by a limit state equation gj{X) = 0 in 
X-space, the direct extension of the fundamental reliability problem given in Eq. (4.1.6a) is 

Pf = hex'" J h{X)dX (5 ' 16) 

where X is the vector of all basic random variables and 0, is the domain m X defining failure 
of the system. This is defined in terms of the various failure modes as gj (X) < 0. In two- 
dimensional X-space, Eq. (5.16) is defined in Fig. 5.7 with 0 and 9j (X) < 0 shown shaded. 


r 2 

% 

t Q 

(a) 

Fig. 5.6 Series system 

If the limit state function gj (U) = 0 in U-space corresponding to gj (X) = 0 in X-space is 
linearized at the design point (Fig. 5.8), the failure probability of jth element can be calculated 

as 




Pf = P( gi (U) < 0) « P{Pj + SjU < 0) 


(5.17) 


where Sj is the unit normal vector at the design point and /?j is the safety index. 
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I Hx x 

Fig. 5.7 Basic structural reliability problem in two dimensions 


An approximation of the failure probability Pj of the series system shown in Fig. 5.6 can 
be computed as [4] 

p, = / , (u‘ = ,te(co<o}) 

= p^UiSiU < -ft}) 

= 1 - P( r 'U^ S i U > “ft}) 

= 1 - < M) 

= (5.18) 

where j) = (ft, ft,. 
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Fig. 5.8 Linearized limit state surface at the MPP in U-space 

Using Eq. (5.18), the calculation of the probability of failure of a series system with linear 
and normally distributed safety margins is reduced to calculation of a value of $ k - However, 
calculations of values of $ k for k > 3 can generally only be performed m an approximate way 
or upper and lower bounds must be used. For k = 2, the upper and lower bounds are given in 

Eqs. (5.11) and (5.12). 

Example 5.1 

This example is taken from Ref. [5]. The simple structural system shown in Fig. 5.9 is 
loaded by a single concentrated load P. Assume that system failure is failure in compression in 
element 1 or element 2. Let the load-carrying capacity in the elements 1 and 2 be 1.5 n F and 
assume that P and n F are realizations of independent normally distributed random variables 

P and N f with 

Up = 4kN , crp — 0.8KN 

fi Np = 4 kN, <tn f = OAkN 
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Fig. 5.9 Simple structural system with a single concentrated load 


Safety margins for elements 1 and 2 are 

T p 

M 2 = N f - fp 

Since M x and M 2 are linear functions, the safety indices of M x and M 2 can be easily 
computed using the Mean Value method (Eq. (3.3.7)). 


6-2x72 

; (| x0.4) 2 + (f x 0.8) 2 


= 3.846 


4 - 2V2 

/ (x0.4) 2 + (^ x 0.8) 2 


= 1.691 
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a! = (0.728, -0.686) 
a 2 = (0.577,-0.816) 

So the U-space safety margins can be given as 

Mi = 0.728ui — 0.686^2 + 3.846 
M 2 = 0.577ui — 0.816u 2 + 1.691 
The correlation coefficient between the safety margins is 

p = 0.728 x 0.577 + 0.686 x 0.816 = 0.98 

Therefore, the probability of failure of the system is 

Pj = 1 -$ 2 (3.846,1.691; 0.98) 


5.4 Parallel Systems 

When the elements in a structural system (or subsystem) behave in such a way or are 
so interconnected that the reaching the limit state in any one or more elements does not 
necessarily mean failure of the whole system, the reliability problem becomes one of a “parallel” 
or “redundant” system analysis. Parallel systems can be modeled as in Fig. 5.10. 

Redundancy in systems may be of two types; “active redundancy” occurs when the 
redundant elements actively participate in structural behavior even at low loading and “passive 
redundancy” occurs when the redundant elements do not come into play until the structure 
has suffered a sufficient degree of degradation or failure of its elements. Passive redundancy, or 
“fail-safe” design, implies the availability of a reserve capacity. It increases the reliability of a 
system as is easily demonstrated. However, whether active redundancy is beneficial depends on 
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Fig. 5.10 Parallel system 

the behavior characteristics of the elements. As might be expected, for ideal plastic systems, 

the “static theorem” guarantees that active redundancy can not reduce the reliability of a 
structural system. 

With active redundancy, the failure probability of a k-component parallel system (or 
subsystem) is 

Pf = P(Fs) = P(F 1 n f 2 n ... n F k ) ( 5 . 19 ) 

where i* 1 , is the event failure of the ith component”. It also can be represented in X-space by 

* < 5 - 2 °) 

where O a is the intersection domains shown in Fig. 5.7. 

Since a parallel system can only fail when all its contributory components have reached 
their limit states, it follows that the behavior characteristics of the components are considerably 
important in defining “system failure”. This is in contrast with the situation for series systems. 
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Example 5.2 



Fig. 5.11 Brittle material behavior in parallel system 

This example is taken from Ref. [1] which considers the idealized parallel system shown in 
Fig. 5.11. If the elements are all brittle, with different fracture strains e f the maximum load 
P that can be supported at any particular strain level £ is 

R sys = max[Ri(£) + R 2 {£) + R^)] ( 5 - 21 ) 

where PU = Ai<n(e) for i = 1 to 3. Here A t represents cross-sectional area and represents 
stress. 

Since each resistance &(* = 1,2,3) is a random variable, Eq. (5.21) is not easy to apply. 
Each possible state e n , e f2 and e /3 must be considered as a possible state of maximum capacity. 
Thus, all possible combinations of failed and surviving elements must be considered. Each such 
combination will be a “parallel” subsystem, thus 

R sys = ma x{[Ri(e /2 ) + ife(e /2 ) + + ^(e/i)], ^(e/s)} 

and 

Pj = P{R sys ~ P < 0 ) 
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5.5 System Reliability Bounds 


Rather than proceed with the direct integration of Eqs. (5.4) and (5.20), an alternative 
approach is to develop upper and lower bounds on the probability of failure of a structural 
system. Consider a structural system subject to a sequence of loadings and the system may 
fail in any one (or more) of a number of possible failure modes under any one loading in the 
loading sequence. The total probability of structural failure may then be expressed in terms of 
mode failure probabilities as 

Pf = u P{F 2 n Si) u p(F 3 n s 2 n Si) u P(F 4 n s 3 n s 2 n s a ) u ... (5.22) 

where F, denotes the event “failure of the structure due to failure in the ith mode, for all 
loading” and S, denotes the complementary event “survival of the ith mode under all loading” 
(and hence survival of the structure). Since P(F 2 n Si) = P(F 2 ) - P(F 2 n Fi)..., Eq. (5.22) can 
also be written as 


p f - P( F i) + P(Pi) - P(Fi n f 2 ) + F(F 3 ) - F(Fi n f 3 ) - p(f 2 df 3 ) + p(f x n f 2 n f 3 )... (5.23) 

where {F x fl F 2 ) is the event that failure occurs in both modes 1 and 2. 

5.5.1 First-order Series Bounds 

The probability of failure for the structure can be expressed as P f = 1 - P, where P is the 
probability of survival. For independent failure modes, P can be represented by the product of 
the mode survival probabilities, or, noting that P, = 1 — pf ^ by 

p t = 1 - ni 1 - p .'] (5.24) 

t=l 

where Pf is the probability of failure in mode i. This result can, by expansion, be shown to 
be identical to Eq. (5.23). It follows directly from Eq. (5.23) that, if pf < 1, then Eq. (5.24) 
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can be approximated [3] by 


Pfaj^Pi (5 ' 25) 

t=l 

In the case where all failure modes are fully dependent, it follows directly that the weakest 
failure mode will always be weakest, irrespective of the random nature of the strength. Hence 


Pf 



(5.26) 


Based on Eqs. (5.24) or (5.25) and (5.26), the first-order series bounds on the failure 
probability in terms of the individual failure mode probabilities can be given as [6] 


m (5 ' 27) 

2 t = l t=l 

where k is the number of failure elements, and Pf is the failure probability of individual failure 


modes. 

Unfortunately for many practical structural systems, the series bounds of Eq. (5.27) are too 
wide to be meaningful [7]. Better bounds can be developed, but more expensive computation 

is required. 


Example 5.3 

Consider the structure given in Example 5.1, with two failure elements. The failure 
probability of the system is calculated as 


P f = 1 -$ 2 (3.846,1.691; 0.98) 

where the probabilities of failure of the failure elements 1 and 2 are 


p[ = $(-3,846) = 0.00006 
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P{ = $(-1,691) = 0.04947 

The first-order bounds for the system failure probability are calculated as 

0.04947 < P f < 1 - (1 - 0.00006)(1 - 0.04947) 

0.04947 <Pf < 0.04953 

For this series system p = 0.98. Therefore, the lower bound can be expected to be close to 

Pf- 

5.5.2 Second-order Series Bounds 

Second-order bounds are obtained by retaining terms such as P(F 1 f]F 2 ) in Eq.(5.23), which 
for the case of exposition, may be rewritten as 


Pf = P(Fi) 

+P(F 2 )-P(F 1 DF 2 ) 

+p(f 3 ) - P(F 1 n f 3 ) - p(f 2 n f 3 ) + p(f x n f 2 n f 3 ) 

+p(f 4 ) - p(f 1 n f 4 ) - p(f 2 n f 4 ) - p(f 3 n f 4 ) + p{f x n f 2 n f 4 ) 

+p{Fi n F 3 n f 4 ) + p(f 2 nF 3 n f 4 ) - P(F 1 n f 2 n f 3 n f 4 ) 

P(Fs)-... 

k k k 

= E P ( F <) - E E P( F ‘ n Fi) + E E E p ( p ‘ n Pi n Ft) - ... ( 5 . 28 ) 

,=1 *<3 i<j<l 

Because of the alternating signs as the order of the terms increases, it is evident that 
consideration of only first-order terms ( i.e . P(Fi )) produces an upper bound on P f , and 
consideration of only first- and second-order terms produces a lower bound, first-, second- 
and third-order terms again on upper bound, and so on. 

It should also be clear that consideration of an additional failure mode can not reduce the 
probability of structural failure, so each complete line in Eq. (5.28) makes a non-negative 
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contribution to P,. Noting that P(F, n F,) > P(F, n Fj n F, a lower bound to Eq. (5.28) 
can be obtained if only the terms P(F,) - P(F, n Fj) are retained, provided each makes a 
non-negative contribution [8]: 

P f > P( + E max{P/ - E P(Fi n Fj),0} (5.29a) 

t=2 i=i 

Let = P(F, n Fj), then 

F, > P/ + - E (5 ' 296) 

i=2 i=i 

where P/ = P(Fi)- 

An upper bound can be obtained by simplifying each line in Eq. (5.26) ([8]): 



Therefore, the Ditlevsen second-order bounds are given as 


(5.30) 



(5.31) 


The gap between the Ditlevsen bounds (Eq. 5.31) is usually much smaller than the gap 
between the first-order bounds given in Eq. (5.27).However, the Ditlevsen bounds require 
calculation of the joint probabilities P/ } and these calculations are not trivial. Usually a 
numerical technique must be used. When the safety margins for the failure elements i and 


j are linear and normally distributed, then 


P^ = $ 2 (- A, -&;/>) 


(5.32) 


Example 5.4 

Consider a series system with two failure elements and let the reliability indices be ft = 2.5 
and ft = 3-0 and let the correlation coefficient be p = 0.7. Compute the system failure 
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probability Pj using the first- and second-order series bounds. 

1) First-order bounds 

The failure probabilities of elements 1 and 2 are computed as 

P{ = $(-2.5) = 0.00621, Pi = $(-3.0) = 0.00135 
The first-order series bounds for the system failure probability are 

0.00621 < P f < 1 - (1 - 0.00621)(1 - 0.00135) = 0.00755 

2) Second-order bounds 

From Eqs. (5.7)-(5.12), the approximate joint failure probability P( 2 is calculated as 

max(P u P 2 ) < $ 2 (-/? 1 , -fcp) <Pi + P 2 

where 

D O 3 2.5 x 0.7, . 

Pi = $(— 2.5)$( 7= — ) = 3.88 x 10- 4 

vl — 0.7^ 

P 2 = $(— 3.0)$( ) = 2.49 x 10~ 4 

v 1 — 0.7^ 

so 

3.88 x 10 -4 < P( 2 < 6.37 x 10~ 4 

If the average of the lower and upper bounds for P( 2 is used, i.e., 

P( 2 « 3.88 x 10" 4 + 6.37 x 10“ 4 = 0.00051 
then, the Ditlevsen bounds are 

0.00621 + (0.00135 - 0.00051) < P } < 0.00621 + 0.00135 - 0.00051 
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Pj = 0.00705 


If the upper and lower bounds of P( 2 are used, then the Ditlevsen bounds are 
0.00621 + 0.00135 - 0.00064 < Pj < 0.00621 + 0.00135 - 0.00039 


i 


.e. 


0.00692 < Pj < 0.00717 


5.5.3 First.-order Parallel Bounds 

As in Section 5.5.1, the first-order parallel bounds are given as 


0 < Pj < min Pf ( 5 - 33 ) 

J i 

These bounds are generally of little use, and closer bounds have not been derived [9]. The 
computation of Pj is therefore based on Eq. (5.19) or 

P f = P\ nf =1 {gi(U) < 0 }| ( 5 - 34 ) 

The analysis of parallel system, series system of parallel subsystems, or parallel system of 
series subsystems is not yet as well developed as the analysis of series systems. Some research 

approaches are given in Ref. [9]. 

5.6 System Reliability Calculation Using Approximations 

In the previous section, the system reliability bounds were introduced. From Eqs. (5.27) 
and (5.31), it is evident that the calculations of the element failure probabilities P t and the joint 
failure probabilities P tj are important to obtain the system reliability bounds. As mentioned 
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in Chapter 4, the element failure probability Pf can be calculated by using first-, second- 
and higher-order approximations for the failure surfaces. In this section, the system reliability 
calculations using first-, second- and higher-order approximate failure regions are introduced. 

5.6.1 Series System Reliability Calculation Using First-order Approximations 

In the first-order system reliability calculation, the failure region is approximated by the 
polyhedral region bounded by the tangent hyperplane at the MPP. The corresponding failure 
probability can then be determined from Eq. (4.3.6) given in Section 4.3 for the probability 
contents in polyhedral regions. 

5 6. 1.1 First-orde r System Reliability Analysis Using First-order Series Rounds 

If the first-order series bounds are used to compute the system probability, there is no need 
to calculate the joint failure probability. Thus, the first-order system failure probability using 
the first-order series bounds can be calculated by the following steps: 

1) Compute the element failure probability Pf using 

H = 

2) Estimate system failure probability using the first-order series bounds given in Eq. (5.27); 

k 

max Pf < P } < ^2 Pf 

1 i = 1 

Example 5.5 


A cantilever beam shown in Fig. 5.12 is subjected to a tip load P. Two failure modes of 
the displacement and stress constraints at the tip are considered as 


9l — da 


4PL 3 
Ebh 3 ’ 


displacement 
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Fig. 5.12 Cantilever Beam 

^ = 5 ‘ “ “5fcT» Stress 

where d a is the allowable displacement limit of 0.15m; 5 0 is the allowable stress limit of 
Q.bEApsi-, L, b and h are the length, width and height of the beam, which are 30tn, 0.8359m 
and 2.5093m, respectively. Young’s modulus, E, is 10 7 . The load P and the height of the 
beam are considered random variables with normal distributions. P has a mean of 80.0/6, with 
a standard deviation of a P = 20; and h has a mean of 2.5093, with a standard deviation of 
a h = 0.25. The two failure modes are assumed to be dependent. Estimate the first-order system 
failure probability using the first-order series bounds: 

1) The failure probabilities of elements 1 and 2 are calculated using Pi — $( 3 1 ) . 

p( = $(-&) = $(—2.0922) = 0.0182 
P f = $(_/? 2 ) = $(-1.9766) = 0.0241 

2) The first-order system failure probability is estimated by the first-order series bounds: 

max Pf < Pf < XI Pf 
1 i = i 

i.e. 

0.0241 < P/0.0182 + 0.0241 = 0.0423 
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5.6. 1.2 First-order System Reliability Analysis Using Second-order Series Bounds 



Fig. 5.13 Differences in First-order and Second-order Approximations 
of Joint Failure Set 

If the second-order series bounds are used, there is a need to compute the first-order 
approximation of the joint failure probability. The first-order approximation to P 12 is obtained 
by approximating the joint failure region by the linear safety margins at the design points for 
the two failure modes (Fig. 5.13). Fig. 5.3 shows the projection of the failure surfaces for the 
two failure modes on the plane spanned by the origin and the two design points u * and u*. 
Then the safety margins M\ and Af 2 are calculated using Eq. (5.2), the correlation coefficient p 
is computed using Eq. (5.3), and the joint failure probability P 12 can be obtained by using Eq. 
(5.5) or the simple bounds of Eq. (5.11). The first-order system failure probability analysis 
using the second-order series bounds is summarized as follows 

1) Compute the element failure probability Pj using 

P’ = 

2) Formulate the linear safety margins: 
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Mi = — 53 afcUfc 

fc=i 

n 

m 2 = & - 53 bkUk 

k = 2 

3) Compute the correlation coefficient p: 

n 

p — p\M \ , A^2] = 

fc=l 

4) Compute the joint failure probability Pi 2 using Eq. (5.5) or Eq. (5.11). 

5) Estimate the system failure probability using Eq. (5.31), that is 



Example 5.6 

Compute the first-order system failure probability for Example 5.5 using the second-order 
series bounds: 

1) The first-order element failure probabilities are obtained as 

pf = $(_&) = $(-2.0922) = 0.0182 
pf = $(_&) = $(-1.9766) = 0.0241 

2) The linear safety margins are 

Mi = 0.0182 + 0.4795ui - 0.8775u 2 
M 2 = 1.9766 + 0.6294ii! - 0.7771u 2 

3) The correlation coefficient is obtained as 


p = a.i, + a 2 h = 0.4795 x 0.6294 + (-0.8775) x (-0.7771) = 0.9837 
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4) The joint failure probability is calculated using Eq. (5.5) 


P\2 - $ 2 (— fii, — fop) 

= $(— A)$( — fa) + jf <t>2{— Pi, — fc] z)dz 
= 0.0168 

5) The system failure probability P f is calculated using the second-order series bounds: 

0.0182 + 0.0241 - 0.0168 < P f < 0.0182 + 0.0241 - 0.0168 
so 

Pj = 0.0255 

5.6.2 System Reliability Calcul ation Using Second-order Approximations 

The second-order system reliability method is based on a more accurate approximation of the 
failure surface than the first-order method. The element failure probabilities are computed by 
the second-order reliability methods (SORMs, e.g. Bretung [10], Tvedt [ll]tvedt90,efc.) given 
in Section 4.4 of Chapter 4. The second-order approximation to the joint failure probability 
Pij is calculated by approximating the joint failure set by the linear safety margins at the joint 
point U*j on the joint failure surface closest to the origin. The difference between the first- and 
second-order approximations to P tj is illustrated in Fig. 5.13 for a case of two basic variables. 
In general, u- will not be in the hyperplane spanned by the origin and the design points u* 
and u*; and u* can be found by solving the following optimization problem: 

Min \u T U 

s.t. g t (U ) < 0, 9j (U) < 0 
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(5.35a) 

(5.356) 



Here, the constraints are formulated as inequalities, and the optimal solution does not 
necessarily correspond to an equality sign for both constraints. Any optimization algorithm can 
be used to solve this optimum problem. After solving the joint point f/*-, the safety margins 
can be formulated as 


Mi = p,~Y a k u k (5.36a) 

Jt=l 

Mj = Pj ~Y b kUk (5.366) 

k=l 

where /?,- and Pj are ith and jth failure element safety indices of the linear safety margins at 
the joint point ( 7 * , and a k and b k are the fcth direction cosines of Pi and ft, respectively. The 
correlation coefficient p is computed as 


p — Y akd>k (5.37) 

fc= l 

The joint failure probability given in Eq. (5.5) becomes 


pi = *(-&)*{-&) + -h z ) dz ( 5 - 38 ) 

where 


_ - i , % + ?l- WPS, 

= 2xVi-^ eipl ^ 


(5.39) 


The main steps of computing the second-order system failure probability analysis using the 


second-order series bounds are given as follows: 

1) Compute the element failure probability P( using SORM (Section 4.4) 

2) Find the joint point of the two failure surfaces U% by solving the optimization problem 


given in Eq.(5.35). 

3) Formulate the linear safety margins at the joint point U*j 
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Mi = 0i - ]T a k u k 

k=i 

M 2 = 02 - ^2 bkUk 

k—2 

4) Compute the correlation coefficient p 


p = p[M u M 2 ] = J ~2 a kbk 

k=\ 

5) Compute the joint failure probability P 12 using Eqs. (5.38) and (5.39) 

6) Estimate the system failure probability using Eq. (5.31), that is 


Example 5.7 



t-1 

max{P ’/ — ^2 
i= i 


H’O) < Pi <&/ -i; 

i=l i=2 


max Pf- 
j<i 13 


Compute the system failure probability for Example 5.5 using second-order approximations: 

1) The second-order element failure probabilities using Tvedt’s method (Eq. 4.3.17) are 


P( = 0.0173, P( = 0.0232 

2) Find the joint point of the two failure surfaces C/£ by solving the optimization problem 
given in Eq.(5.35) 

The joint point Uf 2 is found at (0.6439, -2.0372). 

3) Linearize the two failure surfaces at U{ 2 as 


9\(U) = -0.2153(iii - 0.6439) + 0.375(u 2 + 2.0372) 
h{U) = — 0.2153(«i - 0.6439) + 0.25(u 2 + 2.0372) 
Therefore, the minimum distances from the origin to g x (U ) and g 2 (U) are 

0i = 2.0873, 02 = 1-9638 
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The sensitivity factors of gi(U) and g 2 (U) are calculated as 


= 0.49797, a 2 = -0.86719 

h = 0.65263, b 2 = -0.75768 


The linear margins are 


Mi = 2.0873 + 0.49797ui - 0.86719u 2 
M 2 = 1.9638 + 0.65263«i - 0.75768u 2 

4) Obtain the correlation coefficient: 

p = a x b x + a 2 b 2 = 0.49797 x 0.65263 + (-0.86719) x (-0.75768) = 0.982044 

5) Compute the joint failure probability P\ 2 using Eqs. (5.38) and (5.39) 


pi 
r 12 


0.982044 


*(-2.0873)*(-1.9638) + jf 2)rv ^ 

2.0873 2 + 1.9638 2 - 2 x 2.0873 x 1.9638^ 1 
exp[ T^7 2 


0.0184311 x 0.0247787 + 0.0164805 
0.0169372 


6) Calculate the system failure probability Pf using the second-order series bounds: 


0.0173 + 0.0231 - 0.0169 < P f < 0.0173 + 0.0231 - 0.0169 


so 

P f = 0.0236 
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5.6.3 S ystem Reliability Calculation Using Higher-order Approximations 


In the system reliability analysis using higher-order approximations, the element safety 
indices, element failure probabilities, and the joint failure probabilities are calculated using 
the developed two-point adaptive nonlinear approximations [16]. The joint failure set is still 
approximated as the linear safety margins at the joint point £/*■ on the joint failure surface 
closest to the origin (Fig. 5.13). 

The main procedure of the system reliability analysis using higher-order approximations 
includes: 

1) Compute the safety indices of individual failure modes by approximating the failure 
surface using an adaptive nonlinear approximation surface at the design point [13] [14]; 

2) Calculate the higher-order failure probability of individual failure modes using the 
nonlinear approximation in a new rotated standard normal variable space, as given in Section 
4.5 ([15]); 

3) Find the joint point of the two failure surfaces U* } by solving the optimization problem 
given in Eq.(5.35). 

4) Formulate the linear safety margins at the joint point U*-\ 


Mi = fa - QkUk 
k = 1 

M 2 = h - b k u k 

k = 2 

5) Compute the correlation coefficient p: 

n 

p = p[Mi,M 2 ] = T; a k b k 

k= 1 

6) Compute the joint failure probability P 12 using Eqs. (5.38) and (5.39). 

7) Estimate the system failure probability using Eq. (5.31), that is 
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The flow-chart in Fig. 5.14 shows the role of approximations in computing the safety index, 
element, joint and system failure probabilities. The segments utilizing the approximations are 

highlighted in Figure 5.14. 

Example 5.8 

Compute the system failure probability for Example 5.5 using higher-order approximations: 

1) The higher-order element failure probabilities using HORM (Section 4.5) are 

P( = 0.0172, P{ = 0.0231 

2) Find the joint point of the two failure surface t/* by solving the optimization problem 
given in Eq.(5.35) 

The joint point U{ 2 is found at (0.6439, -2.0372). 

3) Linearize two failure surfaces at C/ 12 as 

g x [U) = -0.2153(«i - 0.6439) + 0.375(u 2 + 2.0372) 
g 2 (U) = -0.2153(tti - 0.6439) + 0.25(u 2 + 2.0372) 

Therefore, the minimum distances from the origin to gi(U) and gi{U) are 

^ = 2.0873, h = 1-9638 
The sensitivity factors of g\{U) and gi{ll) are calculated as 

di = 0.49797, d 2 = -0.86719 

h = 0.65263, b 2 = -0.75768 
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The linear margins are 


Mi = 2.0873 + 0.49797ui - 0.86719u 2 
M 2 = 1.9638 + 0.65263m - 0.75768u 2 

4) Obtain the correlation coefficient: 

p = q 1 5 1 + a 2 b 2 = 0.49797 x 0.65263 + (-0.86719) x (-0.75768) = 0.982044 

5) Compute the joint failure probability Pi 2 using Eqs. (5.38) and (5.39). 

/• 0.982044 1 

PL = *(-2.0873)*(-1.9638)+Jf o 

2.0873 2 + 1.9638 2 - 2 x 2.0873 x 1.9638^ 
exp[- x ^ 2 J 

= 0.0184311 x 0.0247787 + 0.0164805 
= 0.0169372 

6) Calculate the system failure probability P, using the second-order series bounds: 

0.0172 + 0.0231 — 0.0169 < Pj < 0.0172 4- 0.0231 — 0.0169 
so 

Pj = 0.0234 

In this example, the element failure probabilities using HORM are very close to the Monte 
Carlo simulation (P/ = 0.0171, P{ = 0.0231), so more accurate system failure probability is 
estimated. The joint failure probability P/ 2 among FORM, SORM and HORM are quite close 
since the linearized surfaces at the joint point are used. More accurate calculations need to 
be used if more accurate results are expected. The system failure probability obtained from 
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FORM has some differences from SORM and HORM, even if the second-order bounds are used 
to calculate Pf. 

The higher-order approximations used in the system failure probability calculation reduce 
the computational cost not only in computing the first- and second-order gradients for 
the element failure probabilities, but also in finding the joint point U{ 2 for joint failure 
probability calculations. Without the use of approximations, finding U{ 2 may need more than 3 
iterations. As the failure elements and random variables increase, the system failure probability 
calculations without using approximations will be more expensive. This example shows HORM 
provides quite an accurate approach for the system failure probability calculations with much 
less computational cost. 

5.7 Summary 

This chapter briefly presented first- and second-order system reliability methods. The 
important class of series systems was analyzed by first- and second-order reliability methods 
using bounds on the system reliability in terms of element and joint failure mode probabilities. 
Because of the increased computational effort involved in calculating the joint failure 
probabilities, the advantages of employing high quality approximations are clear. 
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CHAPTER 6. RELIABILITY BASED STRUCTURAL OPTIMIZATION 


This chapter discusses the importance of multidisciplinary optimization and the inclusion 
of reliability-based constraints in design. Before addressing reliability issues, first a brief 
introduction of mathematical programming techniques, algorithms, sensitivity analysis, design 
variable linking and constraint approximations are discussed. The idea is to introduce the power 
of design optimization tools for minimizing the structural failure risks. Whenever the design 
modification for reliability improvement is involved, this in fact becomes a nested optimization. 
First of all, the reliability index calculation is itself an iterative process with an optimization 
technique for finding the shortest distance from the origin to the limit-state boundary in normal 
space. This optimization loop provides just the P value. At a higher level the designer would 
like to modify the geometries, shapes, sizes, material properties and boundary conditions to 
reduce the failure probability for the critical limit-states. Fig. 6.1 shows this design scheme by 
incorporating various steps involved in multidisciplinary optimization. Two separate iterative 
loops are shown, where the safety index search is an iterative process at each step of the 

reliability optimization. 

6.1 Multidisciplinary Optimization 

Multidisciplinary optimization has a maximum impact at the preliminary stage of system 
design. At this stage, the configuration has been defined and the materials have been selected. 
The design task is the determination of structural sizes that will provide an optimal structure 
while satisfying the numerous requirements that multiple disciplines impose on the structure. 
Automated structural optimization tools shorten the design cycle time and provide locally 
optimal designs. While, an integrated design tool brings in the requirements of diversified 
disciplines into a design frame work and simultaneously considers all the goals before reaching 

an acceptable and improved solution. 
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Fig.6.1 Reliability-based Optimization Algorithm Flow-Chart. 
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A general optimization task may be defined in a mathematical form as 
Minimize: 


Subject to: 


Where 


F(X) 

Objective 

(6.1) 

g,(X)< 0 j = 1,. 

Inequality Constraints 

(6.2) 

hk(X) = 0 k — 1, 

Equality Constraints 

(6.3) 

x t l <x t < X, u i = 1,... 

, n Side Constraints 

(6.4) 

X = {X u X 2 ,...,X n } 

Design Variables 

(6.5) 


It is with in the design space defined by the above problem statement that the optimizer 
searches for the best design. 

There are many algorithms which can solve the above stated mathematical problem 
(gradient projection method, feasible directions algorithm, Lagrange multipliers method, 
interior and exterior penalty methods, sequential quadratic programming, etc.). Each algorithm 
has certain merits in solving a specific problem; however, all these methods must face the 
implicit nature of objective and constraint functions. For the most part, these are nonlinear 
functions and need computationally expensive finite element analysis. Since the solution scheme 
is essentially iterative, it involves a large number of structural reanalyses. Therefore the 
computational cost often becomes prohibitive when large scale structures are optimized with 
multidisciplinary requirements. To make the design problem tractable, various approximation 
concepts are utilized at various stages of the design steps. These include: design variable 
linking, temporary deletion of unimportant constraints, and the generation of high quality 
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explicit approximations for the implicit functions. In the following, a brief description of these 
efficiency improvement tools are discussed. 

6.1.1 Design Variable Linking 

Having an independent design variable for each free parameter or finite element gives 
additional degrees of freedom in solving the mathematical optimization problem. But, 
sometimes this results in impractical or difficult to manufacture structures. In addition, solving 
a problem with hundreds or thousands of design variables may not be a tractable one. Hence 
there are several practical advantages in reducing the number of design variables. One way is 
to link the local design variables with global variables. The global variables X are the ones 
that are directly involved in the design process. The local variables are linked to the global 
values through a matrix relationship of the form: 


t = PX (6.6) 

where t is a vector of local variables, X is a vector of global design variables and P is the 
linking matrix. There are various forms of linking options possible based on the physics of the 
problem. The idea is to significantly reduce the number of optimization variables using the P 
matrix. Linking of design variables imposes additional constraints on the problem, and may 
not lead to the lowest possible objective function. 

6.1.2 Sensitivity Analysis 

Mathematical programming approaches to the solution of Equations (6.1) through (6.4) 
typically require the gradients of the objective function and the constraints with respect to the 
design variables. That is: 

8 F ■ n n 

3^ ! = l,2,...,n (6.7) 
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j — lj 2, . . . , Tig, 


i = 1,2 


( 6 . 8 ) 


dg L 

n j -1—7 i a i ' 

Finite difference calculations become burdensome when there are large numbers of design 
variables and constraints. An efficient way to realize these gradients is to use analytical 
gradients. By differentiating the equations of motion for the particular analysis discipline 
with respect to the design variables, one could obtain the derivatives. In the case of reliability 
analysis, the sensitivities of the constraints are used in computing the gradients of the limit 
states using a chain rule of differentiation. 


6.1.3 Reducing the Number of Constraints 

A multidisciplinary design problem often involves a large number of inequality constraints 
- both behavioral and side constraints. The large number of constraints arises because it is 
usually necessary to guard against a wide variety of failure modes m each of several distinct 
loading conditions. During each stage of an iterative process, only critical and potentially 
critical constraints need to be considered. Non-critical and redundant constraints that are not 
currently influencing the iterative design process significantly are temporarily ignored. Two 
commonly used techniques are regionalization and “throw-away” concepts. In regionalization, 
for example under multiple static loading conditions, if the region contains various types of 
finite elements (e.g. bars, shear panels, quadrilaterals, beams) it may be desirable to retain 
one most critical stress constraint for each load condition and element type. The reduction of 
constraints by use of the regionalization concept hinges upon the assumption that the design 
changes made during a stage in the synthesis are not so drastic as to result in a shift of the 
constraint location within a region. In the “throw away” approach, unimportant (redundant 
or very inactive) constraints are temporarily ignored in a particular iteration. 


6.1.4 Approximation Concepts 

The basic objective in this approach of approximate structural analysis is to obtain high 
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quality algebraically explicit expressions for the objective function and behavior constraints. 
These explicit approximations are used in place of the detailed analysis during a stage in the 
iterative process. The function approximations play a very significant role in reliability-based 
optimization and they were extensively discussed in Chapter 3 and were successfully applied 
in computing the safety index, /? and the failure probability, Pj. As the history shows, these 
concepts were extensively used in mathematical optimization and most recently were brought 
to the reliability analysis and design. 

6.1.5 Move Limits 

The approximations built at a specific point are valid with in certain bounds of n-dimensional 
space. In order to maintain the validity of the approximations, limits are placed on how much 
a local design variable can change during a design cycle. Move limits artificially restrict the 
design space. Proper selection of move limits is important for convergence to the optimum. 

In summary the basic problem, during each stage of the iterative process, is made tractable 
by: (a) reducing the number of design variables through linking; (b) reducing the number of 
constraints via regionalization and “throw away”, and (c) by constructing algebraically explicit 
approximations for active constraints as functions of design variables. For the purpose of 
demonstration, one of the widely used mathematical programming techniques, the feasible 
directions algorithm, is described for completeness. Using this procedure the approximate 
problem is solved. 

6.2 Mathematical Optimization Process 

The design variable vector update can be written as 


X 1 = X° + a*5 J (6.9) 

where X° is the initial vector of design variables, S 1 is the search vector, and a is the search 
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parameter. Equation (6.9) represents a one dimensional search since the update on X 1 depends 
only on the single scalar parameter a. a* is the value of a that yields the optimal design in the 
direction defined by S. Finding a* completes the first iteration in the “design” process. In order 
to make any further improvement in the “design,” a new search direction S 2 must be found that 
continues to reduce the objective function. Here we seek a “usable-feasible” direction, m which 
a usable direction is one that moves us downhill and a feasible direction is one that keeps us 
inside the bounds. This situation is shown in Fig 6.2. The mathematical definition of a usable 

search direction is 

VF{X) ■ S < 0 ( 6 - 10 ) 

Equation (6.10) is just the scalar product (dot product )of the gradient of the objective function 
with the search direction. The dot product is the magnitude of VF{X) times the magnitude of 
S times the cosine of the angle between two vectors. Thus the cosine of the angle determines 
the sign of the product since the magnitudes are positive numbers. For the cosine to be zero 
or negative the angle between the vectors must be between 90 and 270 degrees. If the cosine is 
zero, the search direction is at an angle of 90 or 270 from the gradient of the objective function . 
A move in this direction follows a contour on the hill and ( for a small move ) does not increase 
or decrease the function. If the cosine is -1.0, the direction is opposite to the direction of 
V F{X) and is the direction of steepest descent. Thus we wish to find a search direction that 
makes the left-hand side of equation Eq. (6.10) as negative as possible. However, this direction 
must remain within a critical constraint. This is the feasibility requirement which is similar to 
the usability requirement but now is stated with respect to the constraint 

V 5j (X)-5<0 ( 6 - n ) 

Just as for the objective function, the angle between the search direction S and the gradient of 
the constraint must be between 90 and 270 degrees. If the angle is exactly 90 or 270 degrees, 
the search direction is tangent to the constraint boundary. To find the search direction, that 
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*2 



0 


Xl 


Fig. 6. 2 Usable- Feasible Search Direction. 


makes the greatest possible improvement in the objective function but still follows or moves 
inside the bounds, we combine the usability and feasibility requirements. This combination 


creates the following sub-optimizing task: Find the components of the search direction S that 

minimizes 


VF(X) ■ ( S ) 

(6.12) 

subject to: 


Vg : (X)-S< 0 jeJ 

(6.13) 

S ■ S <1 

(6.14) 

Where J is the set of constraints whose values are zero within 

some numerical tolerance. In 
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other words J includes any bounds that we were against, while those bounds somewhere else 
do not matter because we can move towards them for at least some distance without going 
outside. The purpose of Eq. (6.14) is simply to prevent an unbounded solution to the problem 
defined by Eqs. (6.12) and (6.13). In the case of a simple two- variable problem, finding the 
appropriate search direction is quite easy and may be done graphically. In a more general 
case where there are numerous design variables as several active constraints, this becomes a 
sub-problem that is solved as part of the optimization. This problem is linear m S except for 
the quadratic constraint of Eq. (6.14). 

Assuming we can find a usable-feasible search direction, we can now search in this direction. 
If we are moving tangentially along the boundary, as is the case here, we must make corrections 
as we go to stay inside because the boundary is curved. That is, the constraint is assumed 
to be mathematically linear. We continue searching and correcting in this direction until we 
can make no further improvement. The sub-problem of finding a new usable-feasible search 
direction is repeated and is followed by continued search until no search direction can be found 
that improves the design without violating one or more of the constraints. We call this point 
the “optimum”. In the present example, we began inside the bounds, and have sequentially 
improved the design until the optimum was reached. In practice, we start outside of one or 
more boundaries in which case the initial design is infeasible. 

The question now arises: How do we know that we have reached the optimum? The answer 
can be found in what are known as the Kuhn-Tucker conditions. In the case of an unconstrained 
problem, this is simply the condition where the gradient of objective function vanishes (i.e., 
equals zero). In the case of the constrained optimization problem considered here, the conditions 
of optimality are more complex. Now the governing equation is the stationary condition of the 

Lagrangian function: 

L(X, \) = F{X) + jt X MX) 
j= i 

> 0 
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(6.15) 

(6.16) 



The Kuhn-Tucker conditions dictate that the Lagrangian function L(X, A) must have a 
vanishing gradient at the optimum design denoted by X * . However, we must also remember the 
original optimization problem and the inequality conditions. When all of these conditions are 
considered, they lead to the statement of the Kuhn-Tucker necessary conditions for optimality: 
Condition 1: 

X m is feasible. Therefore, for all j, Gj(X*) < 0 (6.17) 

Condition 2: 


— * _ 

= 0 (the product of A j and gj(X *) equals zero) 


(6.18) 


Condition 3: 

M 

Vf'P?-) + £A i V ft (J?-) = 0 (6.19) 

3 - 1 

Aj>0 j = 1,2, ...,M (6.20) 

The physical interpretation of these conditions is that the sum of the gradient of the objective 
and scalars A j multiplied by the associated gradients of all active constraints must vectorially 
add to zero. Fig. 6.3 shows this situation for a simple two-variable function space in which two 
constraints are active at the optimum. 

These are only the necessary conditions and the definition here is actually a bit more 
restrictive than required in some cases. However, it does provide the essential idea. In 
practice, it is difficult to numerically find a design that precisely satisfies the Kuhn-Tucker 
conditions. Also, numerous designs may satisfy these conditions since there may be more 
than one constrained minimum. The importance of the Kuhn-Tucker conditions is that an 
understanding of the necessary conditions for optimality gives us some knowledge of what is 
needed to achieve an optimum. Most of the more powerful methods update the design by the 
relationship as shown 
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*2 



Xo = X q ~ l + aS” 


( 6 . 21 ) 


where : 

q = iteration number 
S = vector search direction 
a* = scalar move parameter 

The product a * S is the design modification at the current step. An initial design must be 
provided, but it does not need to satisfy all of the constraints. One of the most powerful uses 
of optimization is to find a feasible solution to a complicated problem. 

In order to determine a search direction S which improves the design, gradients of the 
objective and critical constraints must be supplied. Ideally, these are computed analytically 
or semi- analy t i cally. This process dramatically increases the size of the problem that can be 
efficiently solved. Finally, a “one-dimensional” search is performed by trying several values of 
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a and interpolating for the one that gives a minimum objective function while satisfying the 
constraints. During this process the objective function and the constraints must be repeatedly 
evaluated. Here the use of approximation methods plays a major role because, the evaluation 
of these constraints would otherwise require a full finite element analysis. 

The Modified Feasible Direction Algorithm 

Now we turn to the actual task of solving the approximate problem. The method 
described here is referred to as the Modified Method of Feasible Directions (Ref.[l]). The 
assumption is that we are provided with an objective function F(X) and constraints 

9j(X) < 0, j = 1,2, ...,n a as well as lower and upper bounds on the design variables. 

Also, the gradients of the objective and constraints are available. We are solving the following 
general problem. 

Find the set of design variables x i = 1, 2 . . . , n contained in a vector X that minimizes 

F{X) (6.22) 

subject to 

9j(X)< 0 j = 1,2, ... ,n g (6.23) 

Xi L < Xi < Xi U i = l,2,...,n (6.24) 

Given an initial X- vector X° , update the design according to Eq. (6.21), which is also repeated 
here 

X< = X q ~ x + a*S* (6.25) 

The optimization process now proceeds in the following steps: 

1. Start, <7 = 0, X q = X°. 

2. q = q + 1. 

3. Evaluate F(X) and gj(X ) where J = 1,2, .. . ,n g . 

4. Identify the set of critical and near critical constraints J. 

5. Calculate VF(X) and Vgj(X) where j € J. 
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6. Determine a usable-feasible search direction S«. 

7. Perform a one- dimensional search to find ot ■ 

8. Set X* = X 9 " 1 + a'S*. 

9. Check convergence to the optimum. If satisfied, exit. Otherwise, go to Step 2. 

The critical parts of the optimization task consist the following: 

1. Find a usable-feasible search direction, S*. 

2. Find the scalar parameter a* that minimizes F(X ) subjected to the constraints. 

3. Test for convergence to X* the optimum, and terminate if convergence is achieved. 

We will discuss each of these in turn. 

Finding the Search Direction S « 

The first step in finding the search direction is to determine which constraints, if any, are 
active or violated. Here an active constraint is defined as one with a value between a small 
negative number and a small positive number. Then, the gradients of the objective function 
and all the active and violated constraints are calculated. Thereafter, a usable feasible search 
direction is found (if one exists). In this case there are three possibilities: 

1. There are no active, or violated constraints. 

2. There are active constraints but no violated constraints. 

3. There are one or more violated constraints. 

Each of these possibilities is handled differently. 

No Acti ve or Violated Constraints (Unconstrained Minimization) 

Frequently at the beginning of the optimization process there are no active or violated 
constraints. In this case the feasibility requirement is automatically met since we can move m 
any direction for at least a short distance without violating any constraints. Thus, we only 
need to find a usable direction which is the one that points down hill. It does not have to be 
the steepest descent direction, but to start the process this is the preferred choice. Therefore 
the initial search direction is simply: 
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So = -VF(X 9 " 1 ) (6.26) 

The steepest descent direction is only used if this is the beginning of the optimization (q = 1) 
or if the last iteration had no active or violated constraints. 

Now assume the last search direction is in the steepest descent direction and there are still 
no active constraints. (If there were no violated constraints before, there will not be any now.) 
The next step can be to search again in the steepest descent direction, which is often done 
(This direction is perpendicular to the previous direction). We can use a “conjugate” search 
direction, or more precisely an ^-conjugate direction where A is a matrix of second partial 
derivatives of the objective function. The A matrix is not actually computed but there are 
methods for approximating A that offer a guaranteed convergence rate for problems where the 
objective function is a quadratic function. 

The Fletcher - Reeves conjugate direction method which is very simple and reliable is a 
good choice. This method defines a search direction as: 

So = -VF(Xo) + a So-' (6.27) 

where a = 

The advantage of using the conjugate search direction is seen from Figures 6.4 and 6.5 which 
show a simple two-variable design space. In Figure 6.4 the search directions are the steepest 
descent directions, whereas in Figure 6.5 the conjugate directions are used. In Figure 6.4 the 
search direction is always perpendicular to the previous direction. On the other hand in Figure 
6.5 each search direction uses the steepest descent direction plus some fraction of the previous 
direction. 


VF(X^~ 1 ) I 2 
VF(X®~ 2 ) 


(6.28) 
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xi 


Fig. 6.4 Geometric Interpretation of the Steepest Descent Method. 

Active but no violated constraints 

The more common search direction problem, in which the initial design is feasible and there 
is a constraint, is to find a search direction that improves the design but moves parallel to or 
away from a constraint. To solve this problem first find a search direction S that reduces the 
objective function without violating any currently active constraints. The following equations 
state the problem in mathematical terms: 

Find the search direction S 9 that minimizes 

VF(X 9_1 ) • S 9 (6.29) 

subject to 

Vg.,(X 9_1 ) • S 9 j eJ Feasibility condition (6.30) 

S q ■ S q < 1 Bounds on S (6.31) 

This is the same problem as shown in Eqs.(6.12) through (6.14) for finding a usable-feasible 
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Fig.6.5 Geometric Interpretation of the Fletcher-Reeves Method. 

search direction in the physical example of searching for the lowest point on the hill. Note that 
the scalar product is the magnitude of the two vectors multiplied by the cosine of the angle 
between them. Thus the objective of this sub-optimization problem is 

| VF(X 9 " 1 ) | • | S | -005(0) (6.32) 

Since we are minimizing this function we want the cosine of the angle between the two vectors to 
be as large a negative number as possible but within the restriction of Eq. (6.30). Alternatively 
for any angle 6 between 90 and 270 degrees Eq. (6.32) can be made more negative if the 
magnitude of S is increased. Also if S satisfies the requirements of Eq. (6.30), then any increase 
in magnitude of S also satisfies this equation. Therefore it is necessary to bound S which is 
accomplished using Eq. (6.31). 

Assuming the resulting objective function from this subproblem is negative, the usability 
requirement of Eq(6.10) is satisfied. If the objective function defined by Eq. (6.29) cannot be 
forced to be negative, then it follows that no direction exist that reduces the objective function 
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while staying inside the constraints. If this is the case the Kuhn-Tucker conditions are satisfied, 
and the optimization process may be terminated. 

One or more violated constraints 

Now consider the case where one or more constraints are violated. Such a case is shown in 
Figure 6.6 where constraint 9l (X) is violated and g 2 (X) is active. Now we must find a search 
direction back toward the feasible region even if it is necessary to increase the objective function 
to do so. To achieve this, we augment over the direction-finding problem of Eqs.(6.29) through 
(6.31) with a new variable W. This process has no direct physical significance to the problem 
except as a measure of the constraint violation. 



Fig.6.6 Violation of Constraint(s) 


The new direction finding problem is now: 

Find the search direction S and critical variable W that minimizes 

VF(X 9_1 ) • S - (6.33) 
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subject to 


X gj {X q - 1 ) ■ S q + 9jW < 0 j € J 

(6.34) 

S q ■ S q + W < 1 

(6.35) 


For discussion, assume the parameter 6j in Eq. (6.34) is equal to 1.0, and the parameter 
W is a very large positive number. Then the second term dominates the minimizing of the 
function defined by Eq. (6.33). Therefore, any increase in the variable W forces the objective 
function to be more and more negative (i.e., it reduces the objective of the direction finding 
problem). However for W to increase the first term in Eq. (6.34) must become more and more 
negative. Since S q is bounded by Eq. (6.35), the cosine of the angle between Xg J (X q ~ 1 ) and 
S q must be moved closer and closer to -1.0 . For this to happen, S q must point in a direction 
opposite to gj{X q ~ l ). That is S q must point straight back toward the feasible region. The first 
term in Eq.(6.33) is included simply as a means to reduce the true objective function if possible 
while seeking a feasible design. 

Now consider the value of 6j in Eq.(6.34). This is referred to as a push-off factor since its 
value determines how hard to push away from this violated constraint. If 0i = 0, then even 
increasing W does not require a move anywhere except tangent to the constraint. Also this 
move will probably not move the design back to the feasible region. Therefore some positive 
value is needed. In optimizer, the more the constraint is violated, the greater the push-off away 
from the violated constraint. Finally, the value of ip is initially chosen as a small number, such 
as 5.0. 

One dimensional search 

Having determined a usable-feasible search direction, the problem now becomes one of 
determining how far the optimization can move in that direction. A variety of possibilities 
exist depending on the starting point X q ~ l . However, in each case, the optimization program 
makes use of polynomial approximations to the objective and constrained functions in the one- 
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dimensional direction defined by S. The basic concept is to try some initial value for a* in 
Eq.(6.25) and evaluate the corresponding objective and constraint functions. At the beginning 
of the optimization process, very little information is available except that the function values 
and their derivatives with respect to a* are available. However, we consider the objective 
function (the same algebra applies to constraints) and create a first order approximation to 
F(a *) in terms of a*. 


F(X*) = F{X q ~ l + a* 5") 
Thus, a linear approximation to F(X q ) is 


or 


F(X*) = FiX”- 1 ) + 



anfr- 1 ) ! \dXn\ 
dXi J j 


a 


(6.36) 


(6.37) 


f (*') = F(X’-') + \ dF{ £, - 

But [Mffi-l] is just the j-th entry of VF( J?'" 1 ), or [VF(jf'-‘)l, . 
Also from Eq.(6.25), [§Jf] = S, . Therefore, 


(6.38) 


dFjX* x ) _ v ^ j£ 9 -1) . gq (6.39) 

da * 

Since both terms in Eq.(6.37) are available, we have the slope of function at a* = 0 for any 
function (objective or constraint ) for which the gradient is available. 

Now consider how this information might be used. Since this is the first step in the 
optimization process, we may try to reduce the objective function by some fraction, for example 
10%, which can be stated as 


F(X<) = F{X“- 1 ) + 


dF{ * q l l . a* = FiX*- 1 ) - 0.1- | F(A 9_1 ) | 

da' 


(6.40) 
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from which a proposed a* is obtained as follows: 


<*e st* 


0.1- | F{X^) I 

da * 


(6.41) 


This results in an estimate of a* which reduces the objective function by 10% . However 
since the gradients of some constraints are probably available, the other possible moves can 
be calculated as well. Remember that Eq.(6.38) applies to a constraint by simply substituting 
the constraint gradient for the objective gradient. Now assume that some constraint gradients 
for the constraints exist that are not critical, and it is desired to estimate how far to move to 
make one of them critical. That is, instead of reducing the value of the function by 10%, as was 
done for the objective, it is desired to estimate a move in a* that places it near the constraint 
boundary. Thus, a linear approximation to find gj(X^) = 0, is 




da* 


a* = 0 


and an estimate for a* is 


(6.42) 






dot * 


(6.43) 


Therefore, even at the beginning of the one dimensional search a considerable amount of 
information is available to direct the process. Using the estimates for a* given by Eq.(6.41) 
and Eq.(6.43) for each non-critical constraint, the smallest positive proposed a* is taken as the 
first estimate of how far to move. 

If constraints are currently violated, Eq.(6.43) can still be used. Applying this 
approximation to all violated constraints, the largest proposed value of a* is selected as an 
estimate of how far to move to overcome all constraint violations. If the projected move to a 
constraint that is not currently active is smaller than this, then only move to that constraint as 
a first estimate since we do not want to add new constraints to the set of violated constraints. 
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Using similar approximations, we can also estimate an upper bound on a* that forces all design 
variables to their lower or upper bounds. Then this provides a maximum allowable value for 

a*. 

The one-dimensional search process now proceeds to find the bounds on the a* that contain 
the solution. Once the bounds on a* are known, the constrained minimum is found by 
interpolation. Since S q has been chosen as a direction of improving the design, the search 
can be limited to positive values of a*. At this point, the best search direction to improve the 
design is determined and is conducted in that direction. 

Convergence to the Optimum 

Since numerical optimization is an iterative process, one of the most critical and difficult 
task is determining when to stop. It is important to remember that the process described in 
this section only relates to the solution of the approximate optimization problem. The number 
of cycles through the entire design process is controlled similar criteria. 

The first criterion requires that the relative change in the objective between iterations is 

less than a specified tolerance. Thus the criterion is satisfied if: 

| F(Xi) - FjX^} I < o 001 (6-44) 

I F(X<-') | 

The second criterion is that the absolute change in the objective between the iterations is less 
than a specified tolerance. This criterion is satisfied if 

| p pfr) - F(X q ~ l ) | < 0.0001 (6-45) 

6.3 Summary 

This section has attempted to provide a brief overview of the computational details of the 
optimization process. The method described here is known as the modified method of feasible 
directions. The one-dimensional search problem is generally referred to as the polynomial 
interpolation with bounds. The algorithm presented here is available as the software package 
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DOT (Design Optimization Tools) [3]. Several structural problems were optimized using the 
algorithms presented in this report. The examples include frame, plate and truss structures 
with stress, displacement, and frequency constraints. Multiple load conditions and constraints 
are considered [4- 6]. The efficiency of using adaptive approximations in reliability analysis 
and optimization are well documented in the published papers [7-9]. Hence they are simply 
referenced. 

Also, this work developed a Graphical User Interface which simplifies and helps the selection 
of random variables, distributions and solution strategies. Again, results are available in 
published papersflO]. The procedure was demonstrated on a turbine blade problem. 

* 
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Appendix A: Multivariate Hermite Approximation 


In order to demonstrate that the proposed Hermite function possesses the same value and 
the same derivatives at each of the p data points as the exact function, rewriting Eq. (2.5.3a), 
hi(S) at the t th known point St can be given as 


hi(St) = 


(St - Si) T (Si - S l ) (S t -S 2 ) T (S t -S 2 ) (S t - Sj) T (Si - Sj) 

(Si - s 1 ) T (s t - Si ) ' (s t - s 2 ) T (Si - s 2 y-(Si - sy T (s t - sy 

(S t - S p ) T (Si - S p ) 

j r 


( Si-Sp) T (Si-s p y (A1) 

Using this equation, it is easy to prove that hi(S t ) = 1 when t = i because the numerator 
is the same as the denominator for this case. When t is not equal to i, t must be the same as 
one of j values (j=l,2,...p, j ^ i) because j is also not equal to i. So a zero term appears in 
the product terms of Eq. (A.l) so that h t (St) equals zero. Therefore, h,(S) at the known data 
points S t (t=l,2,...p) satisfy 

hi(St) 


■! 


t = i 


* = 1,2 ,-.,p, 


t ^ i 

t = l,2,...,p 


(A.2) 


Based on this equation and Eq. (2.5.3c), it is esy to prove that the derivatives of h{(S) at the 
known data points S t (t=l,2,...,p) satisfy 


dkj(St) 

ds k 


( 0 t 7^ i 


t — i 


i — 2, ..., p, 


t = 1,2 ,...,p 


(A3) 


Substituting Eqs. (A. 2) and (A. 3) into (2.5.4), the function value at the t th known point can 
be written as 


/(&) = E{«( 5 0 + [V«(Si) - 2 g(Si) v A,-(&)] T (5. - S.)}hKS,) (AAa) 
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The summation can be expanded as two parts 


f(S t ) = { g{S t ) + [\79{St) - 2 g(S t ) V h t (S t )] T • 0 }h 2 t {S t ) 

+ E {g(S,) + [Vg(Si) - 2g{Si) v hi{Si)} T {S t - 5,)} • 0 

i=l,t 

= g(S t ) 


(A. 46) 


Substituting Eqs. (A.2) and (A.3) into (2.5.5), the derivatives at the t th known point can 
be written as 

Sjf(St) = 'tfaiSt) V hi{S t ){g(Si ) + [vg{Si) - 2</($) v M$)] T (& " 5 *)} 

+h 2 i(St)[Vg(Si) - 2 g(Si) v HSi)]} ( A5a ) 

Again, by the expanding the summation into two parts 


V/(S t ) = 26«(S«) v M$){s(S«) + [V^«) -2flf(5,) V MS t )] T ‘ 0} 
+6*(S t )[V5(St) - 2 g(5 t ) V 6<(5 t )] 

+ E {2*0-0-{<?(^) + [V5(5,)-2fif(5,)- vM&)] T (St - £•)} 

+0 • [vpI-S'O - 2 g(Si) V M$)]} 

= 26t(5 t ) v h t (S t )g{S t ) + 6? (S t ) V $(&) _ 2 h 2 (S t ) V 6 t (5 t )^(5 t ) 

= 2 V 6t(S , t )^(5t) + - 2 V h t {S t )g(S t ) 

= Vs(&) ( A - 56 ) 

Eqs. (A.4) and (A. 5) demonstrate that the proposed multivariate Hermite approximation 
possesses the same function values and derivatives at each of the known data points as the 
original information. 
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Appendix B: Parameters of the Distribution of a Random Variable 


B.l Expected Value 

Expected value is sometimes called the mathematical expectation, or expectation or the 
mean value of the random variable. 

For a discrete polulation, the mean is just the summation of all discrete values where each 
value is weighted for the probability of its occurence. 

Let i be a random variable of the discrete type with jump points r* and probabilities p*. . 
The expected value of the random variable can be expressed as 


E(x ) = Yj x kPk 

k = 1 

if the series is absolutely convergent. 

For a continuous type, let f x (x) be the density function 
value of the random variable can be expressed as 

/ +oo 

xf x (x)dx 

-CO 

if the intergral xf r (x)dx is absolutely convergent. 

B.2 Variance 

The variance of a random variable X is the expected value of its squared deviation from 
its expected value p, denoted by Var(X) or cr 2 , or the measure of dispersion of the random 
variable around its expected value. 

Let X be a random variable of the discrete type with jump points Xk and probabilities pk . 


(B.l) 

of random variable x. The expected 


(B.2) 
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The variance of the random variable can be expressed as 

Var(X) = E[(X - E{X)) 2 } = E[(X - /x) 2 ] 

B.3 Expected Value and Variance of Functions 

B.3.1 Expected value of functions 

Consider y = g{x) as the single- valued function of x and x as a random of the discrete type 
with jump points x k and probabilities p k . The expected value of the random variable g(x) can 
be expressed as 


E(y) = 5[p(x)j = Y,Pkg{x k ) {B-3) 

Jt=l 

if the series is absolutely convergent. 

Also, let x be a random variable of the continuous type with density function / x (^)- The 
expected value of the random variable g(x) can be expressed as 

E{y) = E[g{x)] = f g(x)f x (x)dx (5.4) 

if the integral /+£ g{x)f x {x)dx is absolutely convergent. 

B.3. 2 Variance of linear functions 

Given n random variable X\, X 2 , ..., x n and a set of n constants Cj, C 2 , ..., c n , the linear 
function is expressed as 


n 

Z = c ‘ x « 

t = 1 


The expected value of the function Z is 


(5.5) 
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E(Z) = Y J c i E(x i ) (B. 6) 

t=i 


The variance of Z is 


Var(Z) = c . 2<7 1 + J2J2 CiCjPijO- Xi a Xj , i / j (B.7) 

i- 1 t=l j=l 

where pij is the correlation coefficient of x, and xj. If n random variables are independent, then 


yar(Z)=£c?< 

t=l 


(B.8) 
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Appendix C: Calculation of Coordinates g 


A secant formula is used for calculating the coordinates g a and gb- 


Vi+2 


= rji 


Vi Vi + 1 

9i 

9i ~ 9i+ 1 


(C.l) 


where <7; and gi+i are the performance function values at Y a or Yb with g « and Vi+i, respectively. 
By taking one data point, say Yb, calculation of Vb is explained. Va can be obtained using a 
similar procedure. For initial trial points, it is convenient to first examine gi — ft, an( i 
performance function value g\ at the point Yb (k 3 , k 3 , . . . , gi) is calculated. The sign of Q\ is 
used for determining whether g is greater or smaller than /3. If g\ > 0, g 2 = (1 + 0.5 k 2 )0, 
otherwise, t ? 2 = (1 — 0.5 A: 2 )/?. With these two initial points, g\ and g 3 , the equation given in 
Eq. (C.l) is used to obtain g 3 and a new point Yb(k & , k/3 , ..., 773). The performance function 
value g 3 at Y b is calculated to check whether Y h is on the limit state surface or not. If it is on 
the surface, stop the iteration; otherwise, continue using Eq. (C.l) until # + 2(F6)=0. 
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Appendix D: Asymptotic Expansion of a Multinormal Integral 


In Ref. [14] of Chapter 4 (this report), asymptotic expansions are given for integrals of the 
form 


/(A) = f exp(X)f(U))f 0 (U)dU, (A oo) (D.l) 

Jd 

D is a fixed domain in the n-dimensional space, f(U) and f 0 (U ) are at least two times 
continuously differentiable functions. Further, it is assumed that the boundary of D is given 
by the point U with h(U ) = 0, where h(U) is also at least twice continuously differentiable. 
It is shown that, if f(U) has no global maximum with respect to D at an interior point of D, 
the asymptotic behavior of /(A) depends on the points on the boundary where f(U) attains 
its global maximum on the boundary. Due to the Lagrange multiplier theorem, a necessary 
condition for these points is that V/(17) = K ■ Vh(U) ( K is a constant). The contribution of 
one of these points to the asymptotic expansion of /(A) is given in Eqs. 8, 3, 64, page 340, 
Ref. [14] of Chapter 4 (this report). Defining D = [U\g(U\ 1) < 0], A = jd 2 , f(U) = -\U\ 2 /2, 
h(U) = g(U ; 1), the formula can be applied to obtain an asymptotic expansion for /(/?). Due to 
the assumption made at the beginning, there is only one point U on the surface g(U ; 1) = 0 with 
minimal distance to the origin, i.e. only one point Uo in which —\U\ 2 /2 achieves its maximum. 
Eqs. 8,3,64 yields then 

m ~ )/r<w>| J\-V\ (/? _ oo) (D.2) 

with 

J = E E UiUlcofi-Sij - Kg tJ ) (D. 3) 

1 = 1 jf = l 

where 
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Uq = it h component of Uo 


Sij = 8 Kronecker Symbol 
f> 2 g(U; 1), 

9ii = ~a^r ]v - a - 

K = |A <,([/„; 1)|-' 

cof(— 8ij — Kgij) denotes the cofactor of the element (— <5,j — Kgij ) in the matrix 
(-8 i} - Kgij) ij=1 n . Since \U 0 \ = 1, the formula simplifies 

1 ( 0 ) ~ (27r)( n - 1 ) /2 exp(^)^- (n+1) |J| _1/2 ( DA ) 

Due to the rotational symmetry it can be assumed for further considerations, that Uo — 
(0, 1) (i.e. the unit vector in the direction of the u n -axis). Then, since Uo is parallel to 

the gradient of g(U] 1) at Uo due to the Lagrange multiplier theorem, the tangential space of 
the hyper surface at Uo is spanned by the unit vectors in the direction of the first n 1 axes. 
Then J is given (using the definition of the cofactor): 

|J| = \ co f[-8 nn - Kg nn ]| = \det(B)\ (D. 5) 

With B = (6i m + -K<7lm)l,m=l,...,n-1 

Defining 

D — ( K g\m)\ t rn=\,...,n — 1 

and denoting the unity matrix by I: 


det(B) = det(I - D ) 


(D.6) 



Det(B) is given by the product of the eigenvalues of B , which are the roots of det(B — kI) = 
det(( 1 — k)I — D). But these roots are given by 1 — /c,- (i = — 1), in which the k* are 

the eigenvalues of the matrix D. This gives: 

+ (O.T) 

3 = 1 

These eigenvalues are the main curvatures of the surface at Uq. The curvature is defined 
positive. Eq. (D.7) shows, in which cases the approximation is not applicable. Since Uq is a 
point on the surface with minimal distance to the origin, the main curvatures at Uq must not 
be larger than unity, elsewhere, consider a point U on the surface near Uq in the direction of 
a principal axis of curvature at Uq with curvature /c, larger than unity. Due to the definition 
of the curvature, the curve on the surface connecting Uq and U is approximated by a part of 
a circle in the same direction through Uq with radius ^ and center (0, ..., 0,1 — l/«i). Using 
elementary trigonometric relations, for small distances | U — Uq\ the squared distance of U to 
the origin is approximately 




(D. 8 ) 


This contradicts the assumption, that Uq is a point on the surface with minimal distance to 
the origin with respect to the surface and therefore /c, < 1. Due to this 


|J|= nil + «;/?) (D.9) 

3 = 1 

In the case that one curvature is exactly equal to unity, the approximation can not be used. 
Then it becomes necessary to study higher derivatives of g(U) and the global behavior of the 
function. 
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Appendix E: Hermite and Laguerre Integral Parameters 


E.l Hermite Intergal Parameters 

The Hermite integral formula can be used to solve the following integral 

r /w<i*=x;v { '/«.) ( £ -d 

°° 1=1 

where N is the number of Hermite integral terms. The Hermite integral formula with ten terms 

is used, and its parameters are given in Table El. 

For the integration of Eq. (4.3.30), the ten-term Hermite formulas are given as 


O 1 <r2 q cm 

H (0) ^ 1 

i=i 

(E.2a) 

10 0 _ 1 c2 

^) = £A,e { ?-a(r-e ^ 

i=l 

(E. 2b) 

10 1 c2 a cm 

i - i 

(E. 2c) 

10 1 c2 a em 

H W = <T > \ i e$ 

*=1 

(E. 2d) 


For the integration of Eq. (4.3.36), the ten-term Hermite formulas are given as 


10 1 2 1 Q cm 

1 = 1 

(E.3a) 

1° o - l f 7 \ a 

tf (1) = £A t e^ -< m e 24 * *»•» * 

t = l 

(E. 36) 

10 1 c2 L_o_;m 

tf( 2 ) = £ A,e^ • a 2 g m • e + 

i=i 

(E. 3c) 

10 ^ 1 pi \ q cm 

H& = £ A ie «- • a 3 £? m • e + 

(E. 3d) 


1=1 


where A, and & are Hermite integral parameters which are given in Table El. 
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Table El. Hermit e Integral Parameters 


■ 

6 

A,e f - ? 

1 

0.3429013272 

0.6870818540 

2 

-0.3429013272 

0.6870818540 

3 

1.0366108298 

0.7032963231 

4 

-1.0366108298 

0.7032963231 

5 

1.7566836493 

0.7414419319 

6 

-1.7566836493 

0.7414419319 

7 

2.5327316742 

0.8206661264 

8 

-2.5327316742 

0.8206661264 

9 

3.4361591188 

1.0254516914 

10 

-3.4361591188 

1.0254516914 


Table E2. Laguerre Integral Parameters 


■ 

l 



0.1523222277 

0.3914311243 


0.8072200227 

0.9218050285 


2.0051351556 

1.4801279099 


3.7834739733 

2.0867708076 

5 

6.2049567779 

2.7729213897 

6 

9.3729852517 

3.5916260681 

7 

13.4662369111 

4.6487660021 

8 

18.8335977890 

6.2122754198 

9 

26.3740718909 

9.3632182377 
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E. 2 Laguerre Integral Parameters 


The Laguerre integral formula can be used to solve the following integral 

f f(x)dx = '%2ke* i f(£i) ( EA ) 

Jo .=i 

where N is the number of Laguerre integral terms. The Laguerre integral formula with nine 
terms is used, and its parameters are given in Table E2. For the integration of Eq. (4.3.48), 
the nine-term Laguerre formulas are given as 

9 _ 1 F2 a 7m 

Z,(°) = £ A,-e {i • e 2 *' * 

1 = 1 


^ _ _ 1 72 O fff) 

l (1) = J2 ^ ■ a t? • e ? ‘ 00,1 ' 

t=i 

9 _ 1 F2 a 7m 

L (2) = ^A,e«‘-a 2 ^ m -e'^ ^ 
1=1 

L< 3 > = £ A, e * • a 3 g m • 


1=1 


z - 1 c2 a cm 

m =J2~\ ,e €i -e 2$ * 'o- 2 * 


1=1 


1 72 a cm 
„ 2 *** ^0,2^* 


Ll 1 ) = -£A,e €< • a£™ ■ e *»- 

1 72 a 7m 
~ 2 cn 


1 = 1 


9 


i [E.5i i) 


I( 2 ) = ^A,e ?1 ■ a 2 £* m • e -2 '* - * 0 ’ 2 ’ 

«=i 

z(») = - £ A,e* • a 3 £ m • e _2 ^"^ c (£-5&) 

1 = 1 

In the case that all a; are negative, and Vi < 0 and Vi > 0, the integration of Eq. (4.3.49) 
is computed as 


l<°> = E M 

1=1 


__ 172 i _o_ cm 
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Z (1) = - 2 A.-e* • at™ ■ e~^ + ^ 


Z< 2 > = V‘ ■ a 2 g m • e"^ + ^ r 


Z< 3 > = - £ A,-e 6 • a 3 e7 m • e~^ + ^ r 


Z(°) = ^A,e«*-e~^ + ^ r 


_1 S I a <-m 

2^* T co (2 ^ 


iW = ^y-. a (7-e 


Z(2) = £ A,-/* • a 2 ^7 m • e"^ + ^ r 


2(3) = j; A t e* • a 3 £ m • e"^ + ^’ r 

i=i 

where A, and ti are Laguerre integral parameters which are given in Table E2. 
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